Artificial Intelligence's Performance on the Japanese National Dental Examination.

BACKGROUND/PURPOSE: Artificial intelligence (AI) has developed rapidly and is applied to many fields including dental education. In this study, we evaluated AI performance on the Japanese National Dental Examination.

MATERIALS AND

METHODS

We extracted 349 of 400 compulsory questions from the National Dental Examinations over the past five years. Questions were presented to ChatGPT 3.5, ChatGPT 4o mini, and Gemini, and their performance was evaluated across 13 topic categories.

RESULTS

ChatGPT 4o mini achieved the passing criteria for exams for two years and had the highest total score of the three AIs. The scores of ChatGPT 4o mini on "Society and dentistry" and "Cardinal signs" were significantly higher than those of ChatGPT 3.5 (P<0.05).

CONCLUSIONS

The high performance of ChatGPT 4o mini indicates the potential value of the tool in dental education. Further improving its performance may lead to future clinical applications in dentistry.