Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting

Shelly Bagchi; Patrick Holthaus; Gloria Beraldo; Emmanuel Senft; Daniel Hernández García; Zhao Han; Suresh Kumaar Jayaraman; Alessandra Rossi; Connor Esterwood; Antonio Andriella; Paul Pridham

doi:10.1145/3568294.3580162

Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting

Shelly Bagchi, Patrick Holthaus, Gloria Beraldo, Emmanuel Senft, Daniel Hernández García, Zhao Han, Suresh Kumaar Jayaraman, Alessandra Rossi, Connor Esterwood, Antonio Andriella, Paul Pridham

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper, we present a proposed format for reporting human studies in Human-Robot Interaction (HRI). We specifically call out details which are often overlooked or left out of conference and journal papers due to space constraints, and propose a standardized format to contain those details in paper appendices. We expect that providing a formalized study reporting method will promote an increase in replicability and reproducibility of HRI studies, and encourage meta-analysis and review, ultimately increasing the generalizability and validity of HRI research. We consider our draft the first step towards these goals, and we release it to solicit feedback from the HRI community on the included topics.

Original language	English
Title of host publication	Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23)
Publisher	ACM Digital Library
Pages	629-633
DOIs	https://doi.org/10.1145/3568294.3580162
Publication status	Published - 13 Mar 2023

Access to Document

10.1145/3568294.3580162

Cite this

Bagchi, S., Holthaus, P., Beraldo, G., Senft, E., Hernández García, D., Han, Z., Jayaraman, S. K., Rossi, A., Esterwood, C., Andriella, A., & Pridham, P. (2023). Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23) (pp. 629-633). ACM Digital Library. https://doi.org/10.1145/3568294.3580162

@inproceedings{6da45d47ef644a1ab76021c56ea40ced,

title = "Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting",

abstract = "In this paper, we present a proposed format for reporting human studies in Human-Robot Interaction (HRI). We specifically call out details which are often overlooked or left out of conference and journal papers due to space constraints, and propose a standardized format to contain those details in paper appendices. We expect that providing a formalized study reporting method will promote an increase in replicability and reproducibility of HRI studies, and encourage meta-analysis and review, ultimately increasing the generalizability and validity of HRI research. We consider our draft the first step towards these goals, and we release it to solicit feedback from the HRI community on the included topics.",

author = "Shelly Bagchi and Patrick Holthaus and Gloria Beraldo and Emmanuel Senft and {Hern{\'a}ndez Garc{\'i}a}, Daniel and Zhao Han and Jayaraman, {Suresh Kumaar} and Alessandra Rossi and Connor Esterwood and Antonio Andriella and Paul Pridham",

year = "2023",

month = mar,

day = "13",

doi = "10.1145/3568294.3580162",

language = "English",

pages = "629--633",

booktitle = "Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23)",

publisher = "ACM Digital Library",

}

Bagchi, S, Holthaus, P, Beraldo, G, Senft, E, Hernández García, D, Han, Z, Jayaraman, SK, Rossi, A, Esterwood, C, Andriella, A & Pridham, P 2023, Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting. in Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23). ACM Digital Library, pp. 629-633. https://doi.org/10.1145/3568294.3580162

Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting. / Bagchi, Shelly; Holthaus, Patrick; Beraldo, Gloria et al.

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23). ACM Digital Library, 2023. p. 629-633.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting

AU - Bagchi, Shelly

AU - Holthaus, Patrick

AU - Beraldo, Gloria

AU - Senft, Emmanuel

AU - Hernández García, Daniel

AU - Han, Zhao

AU - Jayaraman, Suresh Kumaar

AU - Rossi, Alessandra

AU - Esterwood, Connor

AU - Andriella, Antonio

AU - Pridham, Paul

PY - 2023/3/13

Y1 - 2023/3/13

N2 - In this paper, we present a proposed format for reporting human studies in Human-Robot Interaction (HRI). We specifically call out details which are often overlooked or left out of conference and journal papers due to space constraints, and propose a standardized format to contain those details in paper appendices. We expect that providing a formalized study reporting method will promote an increase in replicability and reproducibility of HRI studies, and encourage meta-analysis and review, ultimately increasing the generalizability and validity of HRI research. We consider our draft the first step towards these goals, and we release it to solicit feedback from the HRI community on the included topics.

AB - In this paper, we present a proposed format for reporting human studies in Human-Robot Interaction (HRI). We specifically call out details which are often overlooked or left out of conference and journal papers due to space constraints, and propose a standardized format to contain those details in paper appendices. We expect that providing a formalized study reporting method will promote an increase in replicability and reproducibility of HRI studies, and encourage meta-analysis and review, ultimately increasing the generalizability and validity of HRI research. We consider our draft the first step towards these goals, and we release it to solicit feedback from the HRI community on the included topics.

U2 - 10.1145/3568294.3580162

DO - 10.1145/3568294.3580162

M3 - Conference contribution

SP - 629

EP - 633

BT - Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23)

PB - ACM Digital Library

ER -

Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting

Abstract

Access to Document

Fingerprint

Cite this