Robotic Vision and Multi-View Synergy: Action and activity recognition in assisted living scenarios

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Downloads (Pure)

Abstract

The significance of Human-Robot Interaction (HRI) is increasingly evident when integrating robotics within human-centric settings. A crucial component of effective HRI is Human Activity Recognition (HAR), which is instrumental in enabling robots to respond aptly in human presence, especially within Ambient Assisted Living (AAL) environments. Since robots are generally mobile and their visual perception is often compromised by motion and noise, this paper evaluates methods by merging the robot's mobile perspective with a static viewpoint utilising multi-view deep learning models. We introduce a dual-stream Convolutional 3D (C3D) model to improve vision-based HAR accuracy for robotic applications. Utilising the Robot House Multiview (RHM) dataset, which encompasses a robotic perspective along with three static views (Front, Back, Top), we examine the efficacy of our model and conduct comparisons with the dual-stream ConvNet and Slow-Fast models. The primary objective of this study is to enhance the accuracy of robot viewpoints by integrating them with static views using dual-stream models. The metrics for evaluation include Top-1 and Top-5 accuracy. Our findings reveal that the integration of static views with robotic perspectives significantly boosts HAR accuracy in both Top-1 and Top-5 metrics across all models tested. Moreover, the proposed dual-stream C3D model demonstrates superior performance compared to the other contemporary models in our evaluations.

Original languageEnglish
Title of host publication2024 10th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics, BioRob 2024
Place of PublicationHeidelberg, Germany
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages789-794
Number of pages6
ISBN (Electronic)979-8-3503-8652-3
DOIs
Publication statusPublished - 23 Oct 2024
Event2024 IEEE RAS EMBS 10th International Conference on Biomedical Robotics and Biomechatronics (BioRob) - Heidelberg, Germany
Duration: 1 Sept 20244 Sept 2024
Conference number: 10
https://www.biorob2024.org/

Publication series

NameProceedings of the IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics
ISSN (Print)2155-1774

Conference

Conference2024 IEEE RAS EMBS 10th International Conference on Biomedical Robotics and Biomechatronics (BioRob)
Abbreviated titleIEEE BioRob 2024
Country/TerritoryGermany
CityHeidelberg
Period1/09/244/09/24
Internet address

Fingerprint

Dive into the research topics of 'Robotic Vision and Multi-View Synergy: Action and activity recognition in assisted living scenarios'. Together they form a unique fingerprint.

Cite this