Utilizing Artificial Intelligence for Crafting Medical Examinations: A Medical Education Study with GPT-4

Eyal Klang, Shir Portugez, Raz Gross, Reut Kassif Lerner, Alina Brenner,Mayan Gilboa, Tal Ortal, S. Ron, Vered Robinzon, Hila Meiri,Gad Segal

Research Square (Research Square)(2023)

引用 0|浏览0
暂无评分
摘要
Abstract Background. The task of writing multiple choice question examinations for medical students is complex, timely and requires significant efforts from clinical staff and faculty. Applying artificial intelligence algorithms in this field of medical education may be advisable. Methods. We utilized GPT-4, an OpenAI application, to write a 210 multi choice questions-MCQs examination based on an existing exam template and thoroughly investigated the output by specialist physicians who were blinded to the source of the questions. Algorithm mistakes and inaccuracies were categorized by their characteristics. Results. After inputting a detailed prompt, GPT-4 produced the test rapidly and effectively. Only 1 question (0.5%) was defined as false; 15% of questions necessitated revisions. Errors in the AI-generated questions included: the use of outdated or inaccurate terminology, age-sensitive inaccuracies, gender-sensitive inaccuracies, and geographically sensitive inaccuracies. Questions that were disqualified due to flawed methodology basis included elimination-based questions and questions that did not include elements of integrating knowledge with clinical reasoning. Conclusion. GPT can be used as an adjunctive tool in creating multi-choice question medical examinations yet rigorous inspection by specialist physicians remains pivotal.
更多
查看译文
关键词
medical examinations,medical education study,medical education
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要