AI’s best-known “chatbot” (a nickname for AI that produces language), ChatGPT, is making waves in many industries, including health care. However, it has not yet mastered the art of test-taking—at least not in ophthalmology, gastroenterology, or urology.
ChatGPT Passed Medical Licensing Exam
In an early 2023 study, ChatGPT (just barely) passed the United States Medical Licensing Exam, a mandatory medical licensure requirement. The USMLE consists of three tests, with the first being administered to second-year medical students who usually dedicate 300 to 400 hours to exam preparation. Fourth-year medical school students take the second test, and practicing physicians who have typically completed one-half to one year of postgraduate studies take the third test. Passing all three grants license to practice medicine in the United States without supervision.ChatGPT was given no special preparation for the exam.
