StraightTrack: Towards Mixed Reality Navigation System for Percutaneous K-wire Insertion
Overview:
This is a during-semester project at JHU Laboratory for Computational Sensing + Robotics. The goal is to design a visual navigation system using the Microsoft Hololens 2 HMD to guide surgeons to accurately place guidewire for pelvic fracture surgeries. I designed the GUI and located the pivot point on the patient’s skin through point-cloud data acquired by the AHAT depth camera. This work was accepted by MICCAI-AECAI 2024.
Skills:
MRTK, Hololens2 Research Mode API, OpenCV, Unity 3D, C#
The automatic surgical process from making surface cut to final adjustments near bone.
GUI for tacking and placing the tool. Point cloud data was acquired from native depth camera on Hololens 2 HMD to find the pivot point on patient’s skin.
