VR/MR, LLM-Driven Avatars, Accessibility

Portfolio, Ziming Li

PhD candidate in Computing and Information Sciences at Rochester Institute of Technology, advised by Dr. Roshan L. Peiris. Member of CAIR and AIR Labs. Based in Rochester, NY.

View projects Email me Website GitHub LinkedIn

Last updated 2025-11-09

Focus
VR/MR prototyping, LLM Avatars, XR Accessibility
Tech
Unity, JavaScript, Node.js, Svelte, Vue, C#
Open to
UX Research, UX Engineer, VR/MR Prototyper, Game UX

Selected projects

Environment aware LLM avatar interactions in a grocery scene

Environment and Interaction Aware Gen AI Avatars in VR

LLM agents perceive scene layout and interaction cues, then produce context aligned dialogue and actions for role play training.

VRLLM
VR cafe training with LLM customer avatar

Gen AI Avatars for Job Communication Training in VR

VR role play with AI customers, plus a web CMS for job coaches to author scenarios using text prompts.

VRLLMAccessibility
Avatar Q and A practice screenshot

VR LLM Agents for Public Speaking Q&A

VR and desktop chatbot simulate spontaneous Q and A to reduce anxiety and build confidence.

VRLLM
One handed signing while driving setup

Accessible In Vehicle Communication for DHH Drivers

Wizard of Oz study on one handed signing and fingerspelling for in vehicle interactions, with camera placement trade offs.

AccessibilityAutomotive
Head based haptic rig for VR

SoundHapticVR: Head Based Haptic Audio Cues

Transforms spatial audio into tactile patterns using multi channel actuators to support orientation and awareness.

VRHapticsAccessibility
Sound visualization indicators in Unity

SoundVizVR: Visual Sound Cues for VR

Game engine plugin that renders sound indicators in VR to support DHH players and developers.

UnityAccessibility
One handed signing while driving setup

Accessible In Vehicle Communication for DHH Drivers

Wizard of Oz study on one handed signing and fingerspelling for in vehicle interactions, with camera placement trade offs.

AccessibilityAutomotive
Haptic2FA concept with phone and watch

Enhancing Two-Factor Authentication Accessibility for Blind and Low Vision Users

Replaces visual codes with unique vibration patterns to keep 2FA private and usable with screen readers.

HapticAccessibility
Haptic-Captioning wrist device and components

Enhancing Real-Time Accessibility Through Vibration Feedback

Haptic-Captioning complements captions with wrist vibrations for speaker indication in multi speaker settings.

HapticAccessibility

RotateEntry: Controller Rolling Text Entry for 3DoF VR

Text entry method using controller roll to navigate a virtual QWERTY keyboard, designed for limited motion VR setups.

UnityVRInteraction

Accessible Color Description with Generative AI

Desktop app that captures on screen colors and produces natural language descriptions with configurable LLMs.

ElectronJavaScriptLLM

Games

Crazy Pete’s Space Deals

Satirical business simulation. You play a used spaceship dealer reading customer preferences, managing patience, and maximizing margin.

  • Role UI and UX design, game art, Unity UI implementation
  • Core loop Interview, negotiate, use snacks to keep patience, emphasize features, learn the optimal price after each sale
  • Download Windows build
  • Page Project page

Pave the Way

Endless runner strategy. Use Injector and Disintegrator to keep the robot moving and push the score higher.

  • Role Game design, level design, visual design
  • Rules Injector adds a ground block per shot, Disintegrator removes one block per shot, robot stops for over five seconds means game over
  • Download Windows build
  • Design doc PDF
  • Page Project page

Paint War

2D multiplayer combat with pixel art and chiptune. Modes include 2v2 and free for all. Paint territory while using character skills and items.

Fix the Game

Global Game Jam 2020 entry. A multiplayer party game about repairing a corrupted scene while surviving monster attacks.

Selected Publications

  • Generative Role-Play Communication Training in Virtual Reality for Autistic Individuals: A Study on Job Coach Experiences in Vocational Training Programs, CHI 2025. Details
  • Exploring Large Language Model-Driven Agents for Environment-Aware Spatial Interactions and Conversations in Virtual Reality Role-Play Scenarios, IEEE VR 2025. Details
  • Exploring the SoundVizVR Plugin in the Development of Sound-Accessible Virtual Reality Games: Insights from Game Developers and Players, ACM TACCESS 2024. Details · Code
  • SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing Users, ASSETS 2024. Details
  • Haptic2FA: Haptics-Based Accessible Two-Factor Authentication for Blind and Low Vision People, MobileHCI 2024. Details
  • Exploring the Use of Large Language Model-Driven Chatbots in Virtual Reality to Train Autistic Individuals in Job Communication Skills, CHI EA 2024. Details
  • Haptic-Captioning: Using Audio-Haptic Interfaces to Enhance Speaker Indication in Real-Time Captions for Deaf and Hard-of-Hearing Viewers, CHI 2023. Details
  • SoundVizVR: Sound Indicators for Accessible Sounds in Virtual Reality for Deaf or Hard-of-Hearing Users, ASSETS 2022. Details

Full list with authors, venues, and videos on my site.

Contact

Email zl1398[at]rit.edu, website liziming.com, GitHub Reedo0910, LinkedIn Profile