High-reward, high-risk technologies? An ethical and legal account of AI development in healthcare

BMC Med Ethics. 2025 Jan 15;26(1):4. doi: 10.1186/s12910-024-01158-1.

Abstract

Background: Considering the disruptive potential of AI technology, its current and future impact in healthcare, as well as healthcare professionals' lack of training in how to use it, the paper summarizes how to approach the challenges of AI from an ethical and legal perspective. It concludes with suggestions for improvements to help healthcare professionals better navigate the AI wave.

Methods: We analyzed the literature that specifically discusses ethics and law related to the development and implementation of AI in healthcare as well as relevant normative documents that pertain to both ethical and legal issues. After such analysis, we created categories regrouping the most frequently cited and discussed ethical and legal issues. We then proposed a breakdown within such categories that emphasizes the different - yet often interconnecting - ways in which ethics and law are approached for each category of issues. Finally, we identified several key ideas for healthcare professionals and organizations to better integrate ethics and law into their practices.

Results: We identified six categories of issues related to AI development and implementation in healthcare: (1) privacy; (2) individual autonomy; (3) bias; (4) responsibility and liability; (5) evaluation and oversight; and (6) work, professions and the job market. While each one raises different questions depending on perspective, we propose three main legal and ethical priorities: education and training of healthcare professionals, offering support and guidance throughout the use of AI systems, and integrating the necessary ethical and legal reflection at the heart of the AI tools themselves.

Conclusions: By highlighting the main ethical and legal issues involved in the development and implementation of AI technologies in healthcare, we illustrate their profound effects on professionals as well as their relationship with patients and other organizations in the healthcare sector. We must be able to identify AI technologies in medical practices and distinguish them by their nature so we can better react and respond to them. Healthcare professionals need to work closely with ethicists and lawyers involved in the healthcare system, or the development of reliable and trusted AI will be jeopardized.

Keywords: Artificial intelligence; Ethics; Healthcare; Law; Machine learning.

Publication types

  • Review

MeSH terms

  • Artificial Intelligence* / ethics
  • Confidentiality / ethics
  • Confidentiality / legislation & jurisprudence
  • Delivery of Health Care* / ethics
  • Health Personnel / ethics
  • Humans
  • Liability, Legal
  • Personal Autonomy
  • Privacy*