On-Line Assessment (OLA) as a preparation for the European Diploma in Anaesthesiology and Intensive Care (EDAIC), a retrospective observational study on the results and the potential impact on the Part-I examination

Abstract

Background: The EDAIC is a diploma of the European Society of Anaesthesiology and Intensive Care (ESAIC). which is obtained after passing two a written MCQ-based (Part1) and a structured oral (part2) examinationIn 2011, a formative On-Line Assessment (OLA) was introduced to help candidates to prepare for EDAIC Part1 examination (EDAIC-I). This retrospective observational study evaluated the results of the OLA and its impact on the EDAIC-1 between 2013 and 2019.

Methods: After obtaining the authorisation from the ESAIC Examinations Committee, all the results of candidates registered to OLA and/or EDAIC-I between 2013 and 2019 were included. The total number of registrations and the results were analysed and compared for both.

Results: Over 17,000 candidates (17,401) sat any of the written exams of the EDAIC. The overall pass-rate for the EDAIC-1 was 68.95%. The OLA score increased significantly with the number of attempts for Paper A (Basic Science) (p=0.006). Overall success of the EDAIC-I was higher in candidates who took the OLA before (72.9% versus 68.3%; OR: 1.25; 95% CI [1.12; 1.39]; p<0.001). Candidates who failed in their first attempt for EDAIC-I were more likely to sit the exam again if they had performed the OLA before (OR: 1.396, 95% CI [1.237; 1.574]; p<0.001).

Conclusion: The OLA was associated with an improvement of the results in basic science and success rate in the EDAIC-I.

Keywords: Conocimientos; Diploma Europeo de Anestesiología y Cuidados Intensivos; Educación en anestesiología; Education in anaesthesiology; European Diploma in Anaesthesiology and Intensive Care; Evaluación en línea; Evaluación formativa; Formative assessment; Knowledge; Online Assessment.