Enhancing Virtual Reality Note-taking with LLMs and Users’ Voices

Project Info:

• Platform: Oculus Quest 2
• Tools: Unity & C# & Maya
• Date of Completion: 2023.12
• Contribution: Research Assistant
• Location: University of Notre Dame, South Bend, IN
• Paper Link(Under review): VIVRA

Things I did

• Collaborated on a Unity VR application, leveraging language modeling to enhance team collaboration via the Meta Quest 2.
• Developed, tested, and improved AI-generated text prompts to assist with task segmentation and enhance collaboration.
• Created the user interaction design and the corresponding interface within the VR environment.
• Submitted a paper titled "VIVRA: Enhancing Virtual Reality Notetaking with LLMs and Users' Voices" for review at the 29th Annual ACM Conference on Intelligent User Interface.