TY - JOUR
T1 - Role of Trust in AI-Driven Healthcare Systems: Discussion from the Perspective of Patient Safety
AU - Unver, Mehmet Bilal
AU - Asan, Onur
N1 - © 2021 by Human Factors and Ergonomics Society. This is the accepted manuscript version of a conference proceeding which has been published in final form at https://doi.org/10.1177/232785792211102
PY - 2022/10/6
Y1 - 2022/10/6
N2 - In the field of healthcare, enhancing patient safety depends on several factors (e.g., regulation, technology, care quality, physical environment, human factors) that are interconnected. Artificial Intelligence (AI), along with an increasing realm of use, functions as a component of the overall healthcare system from a multi-agent systems viewpoint. Far from a stand-alone agent, AI cannot be held liable for the flawed decisions in healthcare. Also, AI does not have the capacity to be trusted according to the most prevalent definitions of trust because it does not possess emotive states or cannot be held responsible for their actions. A positive experience of AI reliance comes to be indicative of ‘trustworthiness’ rather than ‘trust’, implying further consequences related to patient safety. From a multi-agent systems viewpoint, ‘trust’ requires all the environmental, psychological and technical conditions being responsive to patient safety. It is fertilized for the overall system in which ‘responsibility’, ‘accountability’, ‘privacy’, ‘transparency; and ‘fairness’ need to be secured for all the parties involved in AI-driven healthcare, given the ethical and legal concerns and their threat to the trust.
AB - In the field of healthcare, enhancing patient safety depends on several factors (e.g., regulation, technology, care quality, physical environment, human factors) that are interconnected. Artificial Intelligence (AI), along with an increasing realm of use, functions as a component of the overall healthcare system from a multi-agent systems viewpoint. Far from a stand-alone agent, AI cannot be held liable for the flawed decisions in healthcare. Also, AI does not have the capacity to be trusted according to the most prevalent definitions of trust because it does not possess emotive states or cannot be held responsible for their actions. A positive experience of AI reliance comes to be indicative of ‘trustworthiness’ rather than ‘trust’, implying further consequences related to patient safety. From a multi-agent systems viewpoint, ‘trust’ requires all the environmental, psychological and technical conditions being responsive to patient safety. It is fertilized for the overall system in which ‘responsibility’, ‘accountability’, ‘privacy’, ‘transparency; and ‘fairness’ need to be secured for all the parties involved in AI-driven healthcare, given the ethical and legal concerns and their threat to the trust.
KW - Artificial Intelligence
KW - healthcare ethics
KW - patient safety
KW - Transparency, trust and accountability
KW - privacy
U2 - 10.1177/2327857922111026
DO - 10.1177/2327857922111026
M3 - Conference article
SN - 2327-8595
VL - 11
SP - 129
EP - 134
JO - Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care
JF - Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care
IS - 1
ER -