Towards using prosody to scaffold lexical meaning in robots

J. Saunders, H. Lehmann, Y. Sato, C.L. Nehaniv

    Research output: Chapter in Book/Report/Conference proceedingOther chapter contribution

    9 Citations (Scopus)


    We present a case-study analysing the prosodic contours and salient word markers of a small corpus of robot-directed speech where the human participants had been asked to talk to a socially interactive robot as if it were a child. We assess whether such contours and salience characteristics could be used to extract relevant information for the subsequent learning and scaffolding of meaning in robots. The study uses measures of pitch, energy and word duration from the participants speech and exploits Pierrehumbert and Hirschberg's theory of the meaning of intonational contours which may provide information on shared belief between speaker and listener. The results indicate that 1) participants use a high number of contours which provide new information markers to the robot, 2) that prosodic question contours reduce as the interactions proceed and 3) that pitch, energy and duration features can provide strong markers for relevant words and 4) there was little evidence that participants altered their prosodic contours in recognition of shared belief. A description and verification of our software which allows the semi-automatic marking of prosodic phrases is also described.
    Original languageEnglish
    Title of host publication2011 IEEE International Conference on Development and Learning, ICDL 2011
    PublisherInstitute of Electrical and Electronics Engineers (IEEE)
    Number of pages7
    ISBN (Print)978-1-61284-989-8
    Publication statusPublished - 2011
    Event2011 IEEE International Conference on Development and Learning (ICDL) - Frankfurt am Main , Germany
    Duration: 24 Aug 201127 Aug 2011


    Conference2011 IEEE International Conference on Development and Learning (ICDL)
    CityFrankfurt am Main


    Dive into the research topics of 'Towards using prosody to scaffold lexical meaning in robots'. Together they form a unique fingerprint.

    Cite this