University of Hertfordshire

Towards using prosody to scaffold lexical meaning in robots

Research output: Chapter in Book/Report/Conference proceedingOther chapter contribution

Standard

Towards using prosody to scaffold lexical meaning in robots. / Saunders, J.; Lehmann, H.; Sato, Y.; Nehaniv, C.L.

2011 IEEE International Conference on Development and Learning, ICDL 2011. Vol. 2 IEEE, 2011.

Research output: Chapter in Book/Report/Conference proceedingOther chapter contribution

Harvard

Saunders, J, Lehmann, H, Sato, Y & Nehaniv, CL 2011, Towards using prosody to scaffold lexical meaning in robots. in 2011 IEEE International Conference on Development and Learning, ICDL 2011. vol. 2, IEEE, 2011 IEEE International Conference on Development and Learning (ICDL), Frankfurt am Main , Germany, 24/08/11. https://doi.org/10.1109/DEVLRN.2011.6037328

APA

Saunders, J., Lehmann, H., Sato, Y., & Nehaniv, C. L. (2011). Towards using prosody to scaffold lexical meaning in robots. In 2011 IEEE International Conference on Development and Learning, ICDL 2011 (Vol. 2). IEEE. https://doi.org/10.1109/DEVLRN.2011.6037328

Vancouver

Saunders J, Lehmann H, Sato Y, Nehaniv CL. Towards using prosody to scaffold lexical meaning in robots. In 2011 IEEE International Conference on Development and Learning, ICDL 2011. Vol. 2. IEEE. 2011 https://doi.org/10.1109/DEVLRN.2011.6037328

Author

Saunders, J. ; Lehmann, H. ; Sato, Y. ; Nehaniv, C.L. / Towards using prosody to scaffold lexical meaning in robots. 2011 IEEE International Conference on Development and Learning, ICDL 2011. Vol. 2 IEEE, 2011.

Bibtex

@inbook{4e5f9e4e5c344571bbb76ce73cd959d2,
title = "Towards using prosody to scaffold lexical meaning in robots",
abstract = "We present a case-study analysing the prosodic contours and salient word markers of a small corpus of robot-directed speech where the human participants had been asked to talk to a socially interactive robot as if it were a child. We assess whether such contours and salience characteristics could be used to extract relevant information for the subsequent learning and scaffolding of meaning in robots. The study uses measures of pitch, energy and word duration from the participants speech and exploits Pierrehumbert and Hirschberg's theory of the meaning of intonational contours which may provide information on shared belief between speaker and listener. The results indicate that 1) participants use a high number of contours which provide new information markers to the robot, 2) that prosodic question contours reduce as the interactions proceed and 3) that pitch, energy and duration features can provide strong markers for relevant words and 4) there was little evidence that participants altered their prosodic contours in recognition of shared belief. A description and verification of our software which allows the semi-automatic marking of prosodic phrases is also described.",
author = "J. Saunders and H. Lehmann and Y. Sato and C.L. Nehaniv",
note = "“This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.{"} “Copyright IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.”",
year = "2011",
doi = "10.1109/DEVLRN.2011.6037328",
language = "English",
isbn = "978-1-61284-989-8",
volume = "2",
booktitle = "2011 IEEE International Conference on Development and Learning, ICDL 2011",
publisher = "IEEE",

}

RIS

TY - CHAP

T1 - Towards using prosody to scaffold lexical meaning in robots

AU - Saunders, J.

AU - Lehmann, H.

AU - Sato, Y.

AU - Nehaniv, C.L.

N1 - “This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder." “Copyright IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.”

PY - 2011

Y1 - 2011

N2 - We present a case-study analysing the prosodic contours and salient word markers of a small corpus of robot-directed speech where the human participants had been asked to talk to a socially interactive robot as if it were a child. We assess whether such contours and salience characteristics could be used to extract relevant information for the subsequent learning and scaffolding of meaning in robots. The study uses measures of pitch, energy and word duration from the participants speech and exploits Pierrehumbert and Hirschberg's theory of the meaning of intonational contours which may provide information on shared belief between speaker and listener. The results indicate that 1) participants use a high number of contours which provide new information markers to the robot, 2) that prosodic question contours reduce as the interactions proceed and 3) that pitch, energy and duration features can provide strong markers for relevant words and 4) there was little evidence that participants altered their prosodic contours in recognition of shared belief. A description and verification of our software which allows the semi-automatic marking of prosodic phrases is also described.

AB - We present a case-study analysing the prosodic contours and salient word markers of a small corpus of robot-directed speech where the human participants had been asked to talk to a socially interactive robot as if it were a child. We assess whether such contours and salience characteristics could be used to extract relevant information for the subsequent learning and scaffolding of meaning in robots. The study uses measures of pitch, energy and word duration from the participants speech and exploits Pierrehumbert and Hirschberg's theory of the meaning of intonational contours which may provide information on shared belief between speaker and listener. The results indicate that 1) participants use a high number of contours which provide new information markers to the robot, 2) that prosodic question contours reduce as the interactions proceed and 3) that pitch, energy and duration features can provide strong markers for relevant words and 4) there was little evidence that participants altered their prosodic contours in recognition of shared belief. A description and verification of our software which allows the semi-automatic marking of prosodic phrases is also described.

UR - http://www.scopus.com/inward/record.url?scp=80055014310&partnerID=8YFLogxK

U2 - 10.1109/DEVLRN.2011.6037328

DO - 10.1109/DEVLRN.2011.6037328

M3 - Other chapter contribution

SN - 978-1-61284-989-8

VL - 2

BT - 2011 IEEE International Conference on Development and Learning, ICDL 2011

PB - IEEE

ER -