University of Hertfordshire

Towards using prosody to scaffold lexical meaning in robots

Research output: Chapter in Book/Report/Conference proceedingOther chapter contribution

View graph of relations
Original languageEnglish
Title of host publication2011 IEEE International Conference on Development and Learning, ICDL 2011
Number of pages7
ISBN (Print)978-1-61284-989-8
Publication statusPublished - 2011
Event2011 IEEE International Conference on Development and Learning (ICDL) - Frankfurt am Main , Germany
Duration: 24 Aug 201127 Aug 2011


Conference2011 IEEE International Conference on Development and Learning (ICDL)
CityFrankfurt am Main


We present a case-study analysing the prosodic contours and salient word markers of a small corpus of robot-directed speech where the human participants had been asked to talk to a socially interactive robot as if it were a child. We assess whether such contours and salience characteristics could be used to extract relevant information for the subsequent learning and scaffolding of meaning in robots. The study uses measures of pitch, energy and word duration from the participants speech and exploits Pierrehumbert and Hirschberg's theory of the meaning of intonational contours which may provide information on shared belief between speaker and listener. The results indicate that 1) participants use a high number of contours which provide new information markers to the robot, 2) that prosodic question contours reduce as the interactions proceed and 3) that pitch, energy and duration features can provide strong markers for relevant words and 4) there was little evidence that participants altered their prosodic contours in recognition of shared belief. A description and verification of our software which allows the semi-automatic marking of prosodic phrases is also described.


“This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder." “Copyright IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.”

ID: 464890