ReHRI'17 - Towards reproducible HRI experiments: Scientific endeavors, benchmarking and standardization

Dimitrios Chrysostomou; Paolo Barattini; Jonah Kildal; Yue Wang; Jacopo Fo; Kerstin Dautenhahn; Francois Ferland; Adriana Tapus; Gurvinder S. Virk

doi:10.1145/3029798.3029800

ReHRI'17 - Towards reproducible HRI experiments: Scientific endeavors, benchmarking and standardization

Dimitrios Chrysostomou, Paolo Barattini, Jonah Kildal, Yue Wang, Jacopo Fo, Kerstin Dautenhahn, Francois Ferland, Adriana Tapus, Gurvinder S. Virk

Centre for AI and Robotics Research

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

This workshop aims at advancing the topic of the relationships between robotics science and experiments in HRI. The full-day workshop follows on previous events in interdisciplinary venues focusing on efforts to establish reproducible, standardized experiments in order to adequately benchmark and evaluate human-robot interaction, scientific achievements and results in the areas of industrial, medical, social, service and personal-care robots. The words "standard" and "standardized" sometimes are misunderstood as fixing and blocking the freedom of the researcher to create new experiments and therefore to advance the scientific knowledge. As per this workshop, the words must be intended as a "way of experimenting temporarily agreed by the community, that is evolving and tracking the scientific progress through continuous revision by the community itself".

Original language	English
Title of host publication	HRI 2017 - Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction
Publisher	Institute of Electrical and Electronics Engineers (IEEE)
Pages	421-422
Number of pages	2
ISBN (Electronic)	9781450348850
DOIs	https://doi.org/10.1145/3029798.3029800
Publication status	Published - 6 Mar 2017
Event	12th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2017 - Vienna, Austria Duration: 6 Mar 2017 → 9 Mar 2017

Conference

Conference	12th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2017
Country/Territory	Austria
City	Vienna
Period	6/03/17 → 9/03/17

Keywords

HRI benchmarking
HRI experiments
HRI metrics
standardization in hri
user studies

Access to Document

10.1145/3029798.3029800

Cite this

Chrysostomou, D., Barattini, P., Kildal, J., Wang, Y., Fo, J., Dautenhahn, K., Ferland, F., Tapus, A., & Virk, G. S. (2017). ReHRI'17 - Towards reproducible HRI experiments: Scientific endeavors, benchmarking and standardization. In HRI 2017 - Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (pp. 421-422). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1145/3029798.3029800

@inproceedings{b8a1a1a73a7c48ba90908e8b155ed4f7,

title = "ReHRI'17 - Towards reproducible HRI experiments: Scientific endeavors, benchmarking and standardization",

abstract = "This workshop aims at advancing the topic of the relationships between robotics science and experiments in HRI. The full-day workshop follows on previous events in interdisciplinary venues focusing on efforts to establish reproducible, standardized experiments in order to adequately benchmark and evaluate human-robot interaction, scientific achievements and results in the areas of industrial, medical, social, service and personal-care robots. The words {"}standard{"} and {"}standardized{"} sometimes are misunderstood as fixing and blocking the freedom of the researcher to create new experiments and therefore to advance the scientific knowledge. As per this workshop, the words must be intended as a {"}way of experimenting temporarily agreed by the community, that is evolving and tracking the scientific progress through continuous revision by the community itself{"}.",

keywords = "HRI benchmarking, HRI experiments, HRI metrics, standardization in hri, user studies",

author = "Dimitrios Chrysostomou and Paolo Barattini and Jonah Kildal and Yue Wang and Jacopo Fo and Kerstin Dautenhahn and Francois Ferland and Adriana Tapus and Virk, {Gurvinder S.}",

year = "2017",

month = mar,

day = "6",

doi = "10.1145/3029798.3029800",

language = "English",

pages = "421--422",

booktitle = "HRI 2017 - Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction",

publisher = "Institute of Electrical and Electronics Engineers (IEEE)",

address = "United States",

note = "12th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2017 ; Conference date: 06-03-2017 Through 09-03-2017",

}

Chrysostomou, D, Barattini, P, Kildal, J, Wang, Y, Fo, J, Dautenhahn, K, Ferland, F, Tapus, A & Virk, GS 2017, ReHRI'17 - Towards reproducible HRI experiments: Scientific endeavors, benchmarking and standardization. in HRI 2017 - Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. Institute of Electrical and Electronics Engineers (IEEE), pp. 421-422, 12th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2017, Vienna, Austria, 6/03/17. https://doi.org/10.1145/3029798.3029800

ReHRI'17 - Towards reproducible HRI experiments: Scientific endeavors, benchmarking and standardization. / Chrysostomou, Dimitrios; Barattini, Paolo; Kildal, Jonah et al.
HRI 2017 - Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. Institute of Electrical and Electronics Engineers (IEEE), 2017. p. 421-422.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - ReHRI'17 - Towards reproducible HRI experiments

T2 - 12th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2017

AU - Chrysostomou, Dimitrios

AU - Barattini, Paolo

AU - Kildal, Jonah

AU - Wang, Yue

AU - Fo, Jacopo

AU - Dautenhahn, Kerstin

AU - Ferland, Francois

AU - Tapus, Adriana

AU - Virk, Gurvinder S.

PY - 2017/3/6

Y1 - 2017/3/6

N2 - This workshop aims at advancing the topic of the relationships between robotics science and experiments in HRI. The full-day workshop follows on previous events in interdisciplinary venues focusing on efforts to establish reproducible, standardized experiments in order to adequately benchmark and evaluate human-robot interaction, scientific achievements and results in the areas of industrial, medical, social, service and personal-care robots. The words "standard" and "standardized" sometimes are misunderstood as fixing and blocking the freedom of the researcher to create new experiments and therefore to advance the scientific knowledge. As per this workshop, the words must be intended as a "way of experimenting temporarily agreed by the community, that is evolving and tracking the scientific progress through continuous revision by the community itself".

AB - This workshop aims at advancing the topic of the relationships between robotics science and experiments in HRI. The full-day workshop follows on previous events in interdisciplinary venues focusing on efforts to establish reproducible, standardized experiments in order to adequately benchmark and evaluate human-robot interaction, scientific achievements and results in the areas of industrial, medical, social, service and personal-care robots. The words "standard" and "standardized" sometimes are misunderstood as fixing and blocking the freedom of the researcher to create new experiments and therefore to advance the scientific knowledge. As per this workshop, the words must be intended as a "way of experimenting temporarily agreed by the community, that is evolving and tracking the scientific progress through continuous revision by the community itself".

KW - HRI benchmarking

KW - HRI experiments

KW - HRI metrics

KW - standardization in hri

KW - user studies

UR - http://www.scopus.com/inward/record.url?scp=85016419398&partnerID=8YFLogxK

U2 - 10.1145/3029798.3029800

DO - 10.1145/3029798.3029800

M3 - Conference contribution

AN - SCOPUS:85016419398

SP - 421

EP - 422

BT - HRI 2017 - Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction

PB - Institute of Electrical and Electronics Engineers (IEEE)

Y2 - 6 March 2017 through 9 March 2017

ER -

Chrysostomou D, Barattini P, Kildal J, Wang Y, Fo J, Dautenhahn K et al. ReHRI'17 - Towards reproducible HRI experiments: Scientific endeavors, benchmarking and standardization. In HRI 2017 - Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. Institute of Electrical and Electronics Engineers (IEEE). 2017. p. 421-422 doi: 10.1145/3029798.3029800

ReHRI'17 - Towards reproducible HRI experiments: Scientific endeavors, benchmarking and standardization

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this