Academic pediatrics · 2025
Validity Evidence for Level of Supervision Scales With Pediatric Subspecialty-Specific Entrustable Professional Activities.
СтатьяВалидационное исследованиеНазвание и аннотация: Перевод в очереди
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Czaja Angela S, Schwartz Alan, James Scott H, Sauer Cary, Mehta Jay J, Kesselheim Jennifer, Weiss Pnina, Turner David A, Stafford Diane E J, Robinson Brad, Rama Jennifer, Pitts Sarah, Moffatt Mary E, Moerdler Scott, McGann Kathleen A, McFadden Vanessa, Mahan John, Lopez Michelle A, Langhan Melissa L, Kamin Daniel S, Karnik Ruchika, Hsu Deborah, High Pam, Herman Bruce, George Roshan P, Fussell Jill J, Dammann Christiane E L, Curran Megan, Chess Patricia R, Boyer Donald L, Aye Tandy, Mink Richard B
Аннотация
OBJECTIVE: To generate validity evidence based on Messick's framework for the use of supervision scales in assessment of the entrustable professional activities (EPAs) specific to each pediatric subspecialty.
METHODS: From 2018 to 2022, we asked clinical competency committees (CCC) from fellowship programs in the United States representing 14 pediatric subspecialties to submit supervision ratings for each EPA for each fellow. Program directors reported the ease of use and time required to assign ratings and familiarity of CCCs with EPAs. Internal consistency for each EPA was assessed through Cronbach's alpha. Mixed effects models were performed to estimate growth in supervision levels across fellowship years. Correlations between adjusted supervision levels and reported milestone ratings for essential subcompetencies were estimated.
RESULTS: We collected EPA-based supervision ratings for 3312 fellows. Most program directors reported that the scales were easy to use and took little time to assign the levels. Internal consistency for each subspecialty-specific EPA was high (alpha 0.89-0.97), as was the inter-EPA consistency within each subspecialty. There was consistent growth in supervision levels across the fellowship training years among all subspecialties. Additionally, there was a positive relationship between supervision levels and milestone-based competencies critical for the performance of the related EPAs (coefficients 0.68-0.80).
CONCLUSIONS: These data provide strong validity evidence for using the subspecialty-specific EPAs supervision scales to assess pediatric fellows. Ongoing evaluation of their use in supporting individualized learning as well as high-stake decisions will be essential.
METHODS: From 2018 to 2022, we asked clinical competency committees (CCC) from fellowship programs in the United States representing 14 pediatric subspecialties to submit supervision ratings for each EPA for each fellow. Program directors reported the ease of use and time required to assign ratings and familiarity of CCCs with EPAs. Internal consistency for each EPA was assessed through Cronbach's alpha. Mixed effects models were performed to estimate growth in supervision levels across fellowship years. Correlations between adjusted supervision levels and reported milestone ratings for essential subcompetencies were estimated.
RESULTS: We collected EPA-based supervision ratings for 3312 fellows. Most program directors reported that the scales were easy to use and took little time to assign the levels. Internal consistency for each subspecialty-specific EPA was high (alpha 0.89-0.97), as was the inter-EPA consistency within each subspecialty. There was consistent growth in supervision levels across the fellowship training years among all subspecialties. Additionally, there was a positive relationship between supervision levels and milestone-based competencies critical for the performance of the related EPAs (coefficients 0.68-0.80).
CONCLUSIONS: These data provide strong validity evidence for using the subspecialty-specific EPAs supervision scales to assess pediatric fellows. Ongoing evaluation of their use in supporting individualized learning as well as high-stake decisions will be essential.