RH-HAR-SK: A Multi-view Dataset with Skeleton Data for Ambient Assisted Living Research

Mohamad Reza Shahabian Alashti, Mohammad Bamorovat Abadi, Patrick Holthaus, Catherine Menon, Farshid Amirabdollahian

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Downloads (Pure)

Abstract

Human and activity detection has always been a vital task in Human-Robot Interaction (HRI) scenarios, such as those involving assistive robots. In particular, skeleton-based Human Activity Recognition (HAR) offers a robust and effective detection method based on human biomechanics. Recent advancements in human pose estimation have made it possible to extract skeleton positioning data accurately and quickly using affordable cameras. In interaction with a human, robots can therefore capture detailed information from a close distance and flexible perspective. However, recognition accuracy is susceptible to robot movements, where the robot often fails to capture the entire scene. To address this we propose the adoption of external cameras to improve the accuracy of activity recognition on a mobile robot. In support of this proposal, we present the dataset RH-HAR-SK that combines multiple camera perspectives augmented with human skeleton extraction obtained by the HRNet pose estimation. We apply qualitative and quantitative analysis techniques to the extracted skeleton and its joints to demonstrate the additional value of external cameras to the robot's recognition pipeline. Results show that while the robot's camera can provide optimal recognition accuracy in some specific scenarios, an external camera increases overall performance.
Original languageEnglish
Title of host publicationACHI 2023: The Sixteenth International Conference on Advances in Computer-Human Interactions
Place of PublicationVenice, Italy
PublisherIARIA
ISBN (Electronic)978-1-68558-078-0
Publication statusPublished - 28 Apr 2023
EventACHI 2023: The Sixteenth International Conference on Advances in Computer-Human Interactions - Venice, Italy
Duration: 24 Apr 202328 Apr 2023
Conference number: 16
https://www.iaria.org/conferences2023/ACHI23.html

Conference

ConferenceACHI 2023: The Sixteenth International Conference on Advances in Computer-Human Interactions
Abbreviated titleACHI 2023
Country/TerritoryItaly
CityVenice
Period24/04/2328/04/23
Internet address

Fingerprint

Dive into the research topics of 'RH-HAR-SK: A Multi-view Dataset with Skeleton Data for Ambient Assisted Living Research'. Together they form a unique fingerprint.

Cite this