2-D Endoscope Video Feed Becomes 3-D With NeRF-Enabled Surgical Tracking System.

A surgical tracking system, called vision-integrated surgical tracking assistance (VISTA), is being developed to use neural radiance fields (NeRFs) to take the current pre-operative computed tomography (CT) scan and video from the surgeon's 2-D endoscope and generate a quickly updated, 3-D view of the sinus surgery field as the surgeon removes tissue. The goal is to make standard sinus surgery procedures more precise and effective, and reduce the need for follow-up surgeries.