Innovations (Philadelphia, Pa.) · 2025
Application of Augmented Reality in Robot-Assisted Mitral Valve Repair Surgery: A Feasibility Study.
СтатьяНазвание и аннотация: Перевод в очереди
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Peek Jette J, Hildebrandt Klaus, Zhang Xucong, Kharbanda Rohit K, Oudeman Maurice A P, Klautz Robert J M, Palmen Meindert, Mahtab Edris A F
Аннотация
OBJECTIVE: In mitral valve surgery, it is important to be aware of adjacent intraoperatively invisible anatomy, to avoid complications and enhance safety. In this feasibility study, we aimed to develop semi-automated intraoperative 3-dimensional (3D) augmented reality (3D-AR) overlays for robotic mitral valve repair.
METHODS: In 5 patients undergoing robot-assisted mitral valve repair, a 3D point cloud was generated, using intraoperatively recorded images from both eyes of the stereoscopic da Vinci camera (Intuitive Surgical, Sunnyvale, CA, USA). An intraoperative 3D-AR overlay was created using a scale-adaptive iterative closest point algorithm and landmarks placed on the mitral valve annulus. Finally, important anatomical structures such as the circumflex artery, Koch's triangle, and aortic valve leaflets could be visualized as a 3D-AR overlay on top of the surgical vision. To evaluate the accuracy, these 3D point clouds were validated by calculating the 3D point cloud accuracy and landmark registration error (LRE).
RESULTS: The 3D point clouds and 3D-AR overlays were successfully created for all 5 patients. The 3D point clouds were accurate, with a median error of -0.92 mm, and the LRE was 5.12 mm. The time for creating the 3D-AR overlay was approximately 5 min. Besides creating the 3D-AR overlays, we could visualize the models directly within the robotic console during the surgical procedure.
CONCLUSIONS: We present an algorithm for generating accurate semiautomatic 3D-AR overlays, visualizing essential anatomical structures during robot-assisted mitral valve repair. This may lead to automated intraoperative 3D-AR vision during robotic cardiac surgery, with the potential of increasing safety, accuracy, and efficiency.
METHODS: In 5 patients undergoing robot-assisted mitral valve repair, a 3D point cloud was generated, using intraoperatively recorded images from both eyes of the stereoscopic da Vinci camera (Intuitive Surgical, Sunnyvale, CA, USA). An intraoperative 3D-AR overlay was created using a scale-adaptive iterative closest point algorithm and landmarks placed on the mitral valve annulus. Finally, important anatomical structures such as the circumflex artery, Koch's triangle, and aortic valve leaflets could be visualized as a 3D-AR overlay on top of the surgical vision. To evaluate the accuracy, these 3D point clouds were validated by calculating the 3D point cloud accuracy and landmark registration error (LRE).
RESULTS: The 3D point clouds and 3D-AR overlays were successfully created for all 5 patients. The 3D point clouds were accurate, with a median error of -0.92 mm, and the LRE was 5.12 mm. The time for creating the 3D-AR overlay was approximately 5 min. Besides creating the 3D-AR overlays, we could visualize the models directly within the robotic console during the surgical procedure.
CONCLUSIONS: We present an algorithm for generating accurate semiautomatic 3D-AR overlays, visualizing essential anatomical structures during robot-assisted mitral valve repair. This may lead to automated intraoperative 3D-AR vision during robotic cardiac surgery, with the potential of increasing safety, accuracy, and efficiency.