Synthetic data and ELSI-focused computational checklists-A survey of biomedical professionals' views

PLOS Digit Health. 2024 Nov 20;3(11):e0000666. doi: 10.1371/journal.pdig.0000666. eCollection 2024 Nov.

Abstract

Artificial intelligence (AI) and machine learning (ML) tools are now proliferating in biomedical contexts, and there is no sign this will slow down any time soon. AI/ML and related technologies promise to improve scientific understanding of health and disease and have the potential to spur the development of innovative and effective diagnostics, treatments, cures, and medical technologies. Concerns about AI/ML are prominent, but attention to two specific aspects of AI/ML have so far received little research attention: synthetic data and computational checklists that might promote not only the reproducibility of AI/ML tools but also increased attention to ethical, legal, and social implications (ELSI) of AI/ML tools. We administered a targeted survey to explore these two items among biomedical professionals in the United States. Our survey findings suggest that there is a gap in familiarity with both synthetic data and computational checklists among AI/ML users and developers and those in ethics-related positions who might be tasked with ensuring the proper use or oversight of AI/ML tools. The findings from this survey study underscore the need for additional ELSI research on synthetic data and computational checklists to inform escalating efforts, including the establishment of laws and policies, to ensure safe, effective, and ethical use of AI in health settings.

Grants and funding

This project was supported in part by a 2022-2023 seed funding award from the Rock Ethics Institute at Penn State University and in part by Award No. 3R01EB027650-03S1 from the National Institute of Biomedical Imaging and Bioengineering (NIBIB) and the National Institutes of Health Office of the Director (NIH OD). The funding sources had no role in the study design, data collection, data analysis, decision to publish, or preparation of this manuscript. The content is solely the authors’ responsibility and does not necessarily represent the official views of any sponsor, university, or other entity. Websites for these funders are https://rockethics.psu.edu/ and https://www.nih.gov/ respectively.