Overview:

Advised by Dr. Dinesh Manocha, I have co-designed and independently programmed a VR multiplayer conference system with live transcription and AI-summary features to help participants keep up with the conversation. The goal is to improve information recall through a gaze-aware, context-aware intelligent summarization system. This system I am building may also benefit people with hearing disabilities. This work was submitted to CHI 2025 (second-author).

Why Important?

This system effectively helps meeting participants keep up with the conversation, which is beneficial for an active discussion. Similar systems can be designed in MR/AR HMD for face-to-face meetings.

Skills:

Study Design, Unity 3D, Photon PUN & Fusion & Voice, Meta Avatar SDK, Prompt Engineering, API Calling