Multi-View Human Activity Recognition in Ambient Assisted Living Using Lightweight Deep Learning Models

A. Bari, H. A. Karim, F. A. Farid, M. Asaduzzaman, F. Amirabdollahian, S. Mansor

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Human Activity Recognition (HAR) is crucial for the development of intelligent assistive technologies in Ambient Assisted Living (AAL) environments. This paper proposes an innovative method for Multi-View Human Activity Recognition (MV-HAR) using lightweight deep learning models, specifically MobileNet and Cyclone-CNN (CCNet), to achieve quick and precise activity detection. Utilizing the Robot House Multi-View Human Activity Recognition (RHM-HAR) dataset, which contains four different views-front, back, ceiling (omni), and mobile robot-our models effectively address challenges related to viewpoint variation and motion dynamics. The dataset includes 14 multi-view daily living action classes, providing a balanced set of synchronized human actions suitable for multi-domain neural network learning. MobileNet and CCNet are employed for their high recognition accuracy, computational efficiency, and real-time application capabilities in AAL scenarios. We propose a Mutual Information (MI)-based method to assess the redundancy and relevance of each viewpoint, ensuring the fusion of multi-view data with minimum redundancy and maximum relevance. Benchmarking results demonstrate that multi-view combinations significantly enhance recognition performance compared to single-view models, particularly in complex activities involving high levels of movement.
Original languageEnglish
Title of host publication2024 International Conference on Electrical, Communication and Computer Engineering (ICECCE)
Place of PublicationKuala Lumpur, Malaysia
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages1-6
Number of pages6
ISBN (Electronic)979-8-3315-2943-7
ISBN (Print)979-8-3315-2942-0
DOIs
Publication statusPublished - 10 Jan 2024
Event2024 International Conference on Electrical, Communication and Computer Engineering (ICECCE) - Honolulu, United States
Duration: 30 Oct 202431 Oct 2024
Conference number: 18

Conference

Conference2024 International Conference on Electrical, Communication and Computer Engineering (ICECCE)
Abbreviated titleICECCE 2024
Country/TerritoryUnited States
CityHonolulu
Period30/10/2431/10/24

Fingerprint

Dive into the research topics of 'Multi-View Human Activity Recognition in Ambient Assisted Living Using Lightweight Deep Learning Models'. Together they form a unique fingerprint.

Cite this