Respiration; international review of thoracic diseases · 2025
Development and Validation of two Bronchoscopy Knowledge Assessments.
СтатьяВалидационное исследованиеПоддержка исследования: вне правительства СШАНазвание и аннотация: Перевод пока не подготовлен
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Gerretsen Eveline C F, Popeijus Herman E, Annema Jouke T, Clementsen Paul F, Corbetta Lorenzo, Gompelmann Daniela, van der Heijden Erik H F M, Hiddinga Birgitta I, van Mook Walther N K A, Munavvar Mohammed, Smeenk Frank W J M, Groenier Marleen
Аннотация
UNLABELLED: <p>Introduction: Simulation-based training (SBT) is a key method for teaching bronchoscopy skills to pulmonology residents. A theoretical foundation can enhance SBT efficiency. This study developed and evaluated the validity of an anatomy and theoretical bronchoscopy exam using Kane's validity framework.
METHODS: Nineteen anatomy and 58 theoretical exam questions, developed by pulmonology experts, were assessed through two Delphi rounds. Both exams were then taken by 53 prepared pulmonology residents. The theoretical exam was also taken by three unprepared groups: novices, intermediates, and experts. Using the residents' data, scoring evidence for the theoretical exam was evaluated using item difficulty and item discrimination indices, and generalization evidence was assessed using Cronbach's alpha. Extrapolation evidence was obtained by comparing theoretical exam scores across the different groups. Implications evidence for both exams was gathered by evaluating residents' preparedness, based on exam performance and instructor feedback.
RESULTS: The Delphi procedure resulted in 19 anatomy and 31 theoretical questions. Item difficulty values predominantly ranged from 0.85 to 1.0; item discrimination indices mostly ranged from 0.0 to 0.25. Cronbach's alpha was 0.55. While scores appeared to correlate with experience, no significant differences were observed between the four groups. Most residents passed both exams on their first attempt, and instructors rated their anatomical knowledge as good.
CONCLUSION: Expert involvement and acceptable item difficulty, item discrimination, and internal consistency supported the exams' validity. The exams also effectively motivated residents to prepare for SBT. These findings highlight the value of pre-SBT exams in enhancing residents' preparation, allowing more time to focus on mastering procedural skills. </p>.
METHODS: Nineteen anatomy and 58 theoretical exam questions, developed by pulmonology experts, were assessed through two Delphi rounds. Both exams were then taken by 53 prepared pulmonology residents. The theoretical exam was also taken by three unprepared groups: novices, intermediates, and experts. Using the residents' data, scoring evidence for the theoretical exam was evaluated using item difficulty and item discrimination indices, and generalization evidence was assessed using Cronbach's alpha. Extrapolation evidence was obtained by comparing theoretical exam scores across the different groups. Implications evidence for both exams was gathered by evaluating residents' preparedness, based on exam performance and instructor feedback.
RESULTS: The Delphi procedure resulted in 19 anatomy and 31 theoretical questions. Item difficulty values predominantly ranged from 0.85 to 1.0; item discrimination indices mostly ranged from 0.0 to 0.25. Cronbach's alpha was 0.55. While scores appeared to correlate with experience, no significant differences were observed between the four groups. Most residents passed both exams on their first attempt, and instructors rated their anatomical knowledge as good.
CONCLUSION: Expert involvement and acceptable item difficulty, item discrimination, and internal consistency supported the exams' validity. The exams also effectively motivated residents to prepare for SBT. These findings highlight the value of pre-SBT exams in enhancing residents' preparation, allowing more time to focus on mastering procedural skills. </p>.