Performance of ChatGPT in Israeli Hebrew Internat Medicine National Residency Exam
The Israel Medical Association journal : IMAJ(2024)
摘要
Background: Completing internat medicine specialty training in Israel involves passing the Israel National Internat Medicine Exam (ShlavAleph), a challenging multiple-choice test. multiple-choice test. Chat generative pre-trained transformer (ChatGPT) 3.5, a language modet, is increasingly used for exam preparation. Objectives: To assess the ability of ChatGPT 3.5 to pass the Israel National Internat Medicine Exam in Hebrew. Methods: Using the 2023 Shlav Aleph exam questions, ChatGPT received prompts in Hebrew. Textual questions were analyzed after the appeal, comparing its answers to the official key. Results: ChatGPT 3.5 correctly answered 36.6% of the 133 analyzed questions, with consistent performance across topics, except for challenges in nephrology and biostatistics. Conclusions: White ChatGPT 3.5 has excelled in English medical exams, its performance in the Hebrew ShlavAleph was suboptimat. Factors include limited training data in Hebrew, translation complexities, and unique language structures. Further investigation is essential for its effective adaptation to Hebrew medical exam preparation.
更多查看译文
关键词
chat generative pre-trained transformer (ChatGPT),exam,Hebrew,internat medicine,residency
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要