Comparing Patient Perception and Physician's Records: Generative AI Performance Evaluation

Stud Health Technol Inform. 2024 Aug 22:316:671-675. doi: 10.3233/SHTI240503.

Abstract

Patient perception involves a patient's thoughts and beliefs regarding their health status. It is also associated with medical compliance and outcomes. However, discrepancies often arise between patient perception and physicians' documentation within the medical records, resulting in misunderstanding and suboptimal doctor-patient communication. In this study, we assessed the efficacy of generative artificial intelligence (AI) in comparing the content of patient perception as recorded in patient questionnaires and physicians' records of the Department of Breast Surgery. We evaluated the precision and recall of the generative AI by comparison with human-created ground truth. Our results demonstrated the high performance of the generative AI in comprehending and contrasting symptoms and the entire content recorded differently by patients and physicians, with F1 scores ranging from 0.77 to 0.97. These results highlight the potential contribution of a generative AI to deeper mutual comprehension in healthcare scenarios.

Keywords: Generative Artificial Intelligence; Medical Records; Patient Perception.

Publication types

  • Comparative Study

MeSH terms

  • Artificial Intelligence*
  • Electronic Health Records*
  • Female
  • Humans
  • Natural Language Processing
  • Physician-Patient Relations*
  • Surveys and Questionnaires