VR Stroke Rehabilitation Game

Unity-Based Therapy for Enhanced Recovery at Trueta Hospital and Mutuam

Overview

In collaboration with the Graphics and Image Laboratory (GILAB) at the University of Girona, we developed a VR-based rehabilitation game using Unity and Oculus Quest for the Trueta Hospital in Girona and Mutuam. This innovative project aims to accelerate the rehabilitation process for stroke patients through immersive virtual reality experiences. A key feature is the mirror effect, which simulates symmetrical arm movements to stimulate the brain and promote recovery of the paralyzed limb. This precise and technical implementation provides a cutting-edge tool for modern rehabilitation.

My Contributions

Scenario Editor System:

Design and Development: Created a robust and flexible scenario editor within Unity, allowing for extensive customization of the virtual environment. This system enables therapists to replicate the patient’s home, enhancing comfort and relaxation during rehabilitation exercises.
Real-Time Editing: Implemented in-game gizmos for real-time editing, providing an intuitive interface for placing and modifying objects within the virtual space.
Asset Library: Developed an extensive furniture library, which can be dynamically loaded and customized to suit individual patient needs.
Data Management: Integrated scene management functionality, including save, load, edit, and delete operations, all seamlessly connected to a database. Utilized C# data models, PHP, and SQL for backend integration, ensuring efficient data handling and storage.
Serialization: Improved database query performance through serialization and deserialization of content, using binary files for data upload and retrieval.

User Interface:

Designed and developed the complete UI for the scenario editor, ensuring an intuitive and user-friendly experience for therapists and patients alike.

VR Mechanics Development:

Hand Recognition: Leveraged the Oculus API to implement hand recognition, enabling natural and responsive interaction within the virtual environment.
Exercise Development: Designed and developed various VR exercises to enhance cognitive and motor skills:
- Memory and Observation: Created a LED board interaction system for memory sequence exercises.
- Shape Copying: Implemented exercises for shape replication to improve visual and spatial skills.
- Tic-Tac-Toe vs AI: Developed a Tic-Tac-Toe game with adjustable AI difficulty to challenge and engage patients.
- Whack-a-Mole: Designed a Whack-a-Mole game for hand-eye coordination and reflex training.
- Object Sorting by Color/Shape: Developed an exercise where patients sort objects by color or shape by pushing them with their hands.
- Precision Finger Exercises: Created an exercise for finger precision where patients classify objects by picking them up and placing them in designated positions, simulating real-life tasks.

Mirror Therapy Implementation:

Symmetrical Movement Simulation: Developed a mirror therapy system where the movement of the functional arm is mirrored to simulate the paralyzed arm, leveraging Unity’s animation and scripting capabilities. This technique exploits the brain’s neuroplasticity to encourage recovery by «tricking» the brain into activating the paralyzed limb.

Agile Methodology:

SCRUM: Followed SCRUM methodology for project management, facilitating iterative development and regular feedback loops from the hospital staff. Conducted on-site sessions to integrate the system and provide training, ensuring that medical personnel could monitor patient progress in real-time.