The Impact of Artificial Intelligence on BI-RADS Classification and Diagnostic Confidence in Mammography Interpretation by Radiology Residents.

BACKGROUND

Artificial intelligence (AI) is increasingly used as a decision-support tool in mammography, but its influence on radiology residents' interpretive behavior remains insufficiently characterized. This study evaluated the impact of AI assistance on BI-RADS classification and diagnostic confidence among radiology residents.

METHODS

This retrospective, single-center, multi-reader paired study included 112 diagnostic mammography examinations, corresponding to 223 assessable breasts and 2230 resident-breast readings. Ten radiology residents interpreted 2D mammography and digital breast tomosynthesis examinations first without AI assistance and subsequently with access to AI output. Changes in the BI-RADS category, diagnostic confidence, reasons for modification, and agreement with an expert-consensus BI-RADS reference standard were analyzed.

RESULTS

AI-assisted reassessment changed the BI-RADS classification in 9.7% of readings and diagnostic confidence in 19.2%, with any AI-associated modification observed in 24.3% of instances. Upgrades were more frequent than downgrades, particularly for medium- and high-suspicion AI outputs. Confidence increased more often than it decreased. Expert-reference agreement improved modestly, and BI-RADS 4+ sensitivity increased from 72.0% to 82.3%, with stable negative agreement, but these metrics reflect agreement with expert BI-RADS consensus rather than pathology-confirmed cancer detection.

CONCLUSIONS

AI assistance influenced both BI-RADS reassessment and diagnostic confidence among radiology residents, producing modest but directionally favorable changes. These findings support cautious, supervised integration of AI into breast imaging training, with attention to confidence calibration and potential overreliance.