Active affective facial analysis for human-robot interaction

Shuzhi Sam Ge, Hooman Aghaebrahimi Samani, Yin Hao Janus Ong, Chang Chieh Hang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

In this paper, we present an active vision system for human-robot interaction purposes that includes robust face detection, tracking, recognition and facial expression analysis. The system will search for human faces in view, zoom on the face of interest based on the face recognition database, track it and finally analyze the emotion parameters on the face. After detection using Haar-cascade classifiers, the variable parameters of the camera are changed adaptively to track the face of the subject by employing the Camshift algorithm, and to extract the facial features which are used for face recognition and facial expression analysis. Embedded Hidden Markov Model is used for face recognition and nonlinear facial mass-spring model is employed to describe the facial muscle's tension. The motion signatures are then classified using Multi-layer Perceptrons for facial expression analysis. This system can be used as a comprehensive and robust vision package for a robot to interact with human beings.

Original languageEnglish
Title of host publicationProceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN
Pages83-88
Number of pages6
DOIs
Publication statusPublished - 2008
Event17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN - Munich, Germany
Duration: 1 Aug 20083 Aug 2008

Publication series

NameProceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN

Conference

Conference17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN
Country/TerritoryGermany
CityMunich
Period1/08/083/08/08

Keywords

  • Emotion recognition
  • Facial expression recognition
  • Facial feature analysis
  • Human-robot interaction
  • Social robot

Fingerprint

Dive into the research topics of 'Active affective facial analysis for human-robot interaction'. Together they form a unique fingerprint.

Cite this