EasyReg: Markerless Rigid Object Registration and Tracking Using All-In-One Mixed Reality Display

Overview:

I have designed an ICP-based algorithm to track rigid objects without fiducial or IR markers using mixed-reality or augmented-reality headset. This on-device markerless tracking method was tested on Hololens 2 HMD, which has an AHAT depth sensor. This work is aiming to be submitted for ISMAR 2025 (first-author).

Why Important?

This markerless registration and tracking approach enables easy tumor localization in the Operating Room, which makes AR system clinically applicable.

Skills:

Computer Vision, Robot Perception, UWP