Improving the fairness and robustness of deep learning classification models through bias mitigation and post hoc calibration.
Обработка статьи · этапы, ошибки и управление
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Ramedani Majid, Terli Jaya C, Martensen Ole H, Strauß Tobias, Buerger Katharina, Dechent Peter, Düzel Emrah, Fliessbach Klaus, Gemenetzi Maria, Glanz Wenzel, Hellmann-Regen Julian, Hetzer Stefan, Incesoy Enise I, Janowitz Daniel, Kronmüller Marie T, Laske Christoph, Lüsebrink Falk, Perneczky Robert, Peters Oliver, Preis Lukas, Priller Josef, Rauchmann Boris-Stephan, Rostamzadeh Ayda, Schneider Anja, Schott Björn H, Sodenkamp Sebastian, Spottke Annika, Spruth Eike J, Stöcklein Sophia, Wiltfang Jens, Jessen Frank, Teipel Stefan J, Dyrba Martin
Аннотация
METHODS: Structural MRI data from three independent cohorts (ADNI, AIBL, and DELCODE) were preprocessed using a standardized pipeline. Age-related bias was addressed using two in-processing strategies, adversarial training (CF-Net) and GLM-based feature residualization (PMDN), implemented in a shared 3D convolutional neural network (CNN) framework. Additionally, post hoc calibration was performed using four regression methods: logistic, probit, isotonic, and Bayesian binning. We evaluated model performance, fairness, and calibration using classification as well as calibration-specific metrics.
RESULTS: PMDN achieved the best overall performance, with higher balanced accuracy (0.71) and improved calibration (Brier ≈ 0.22), showing substantially reduced variability compared to baseline and CF-Net. PMDN effectively removed age-related bias, achieving near-zero age prediction correlation; CF-Net, however, showed only partial and unstable debiasing. Post hoc calibration further improved probability reliability, with nonparametric methods (isotonic regression and Bayesian binning) yielding the lowest calibration errors (MCE ≈ 0.21-0.24).
CONCLUSION: This study shows that, although deep learning models achieve similar classification performance, they differ significantly in terms of calibration, stability, and fairness. PMDN provides more consistent and effective age bias mitigation than the CF-Net approach, particularly in clinically relevant subgroups. Post hoc calibration improves probability reliability further, with nonparametric methods achieving the best calibration.