Multi-user Meditation in VR
A multiplayer VR meditation app using breathing-based visual feedback to guide users into a shared state of calm and mindfulness, supported by an AI companion named Luma.
Initial situation
At the start of the project, a functional base scene (Fireplace Meditation) was already provided by the client. This scene included basic multiplayer infrastructure, breathing detection via controller input, and an AI narrator named Luma. Core components like the Unity VR Multiplayer Template, Netcode setup, and the ZHAW Narrators and FSM packages were integrated. The goal was to build upon this foundation by designing a new meditation environment and improving visual feedback and multiplayer experience.
Problem statement
Although meditation is effective for stress reduction, many people struggle to integrate it into daily life due to limited time, missing guidance, or a lack of suitable environments. Existing VR meditation apps are often limited to single-user use and static feedback. They lack real-time biofeedback and do not support shared meditation experiences. Especially beginners need non-intrusive visual guidance to stay focused. Currently, no VR application combines intuitive breathing-based feedback with a calm, shared virtual meditation environment.
Project goal
The aim of this project is to develop an immersive VR meditation scene that supports both individual and multiplayer experiences. The system provides real-time breathing-based biofeedback through a growing firefly sphere and uses an AI companion for non-verbal guidance. The multiplayer mode enables shared presence without direct interaction to preserve a tranquil atmosphere. The goal is to create an accessible, relaxing, and engaging meditation experience for stressed individuals, using intuitive visual cues and subtle group dynamics to support mindfulness practice.
Selection
The startup screen lets users choose between multiple meditation environments. The newly implemented Mountain Scene was developed during this project and can be selected here before the session begins.
Guided Breathing
In the first part of the meditation, a pulsing sphere guides the user's breathing rhythm. The size of the sphere expands and contracts to indicate when to inhale and exhale, helping users enter a relaxed state.
Biofeedback Fireflies
During the second part of the session, breathing quality is visualized using a firefly sphere. Calm, steady breathing leads to visual growth, giving users intuitive feedback on their relaxation progress.
Multiplayer Meditation
In multiplayer mode, users appear as glowing butterflies with individually chosen glitter effects. They share the same meditation space, creating a calm and immersive atmosphere. Without direct interaction, the presence of others is felt subtly, supporting a collective and peaceful meditation experience.
Solution developed and its benefits
The developed solution is a VR-based meditation application designed to support stress relief through guided breathing exercises, real-time biofeedback, and immersive audiovisual environments. It extends an existing proof of concept by adding a fully developed scene, multiplayer functionality, and adaptive feedback mechanisms.
Core Features
- Pulsing Sphere for guided breathing
- Firefly Sphere reacting to real-time breathing (BPM)
- AI Companion Luma for subtle guidance
- Multiplayer Mode with shared visual feedback
- Custom Mountain Scene with natural soundscapes
Benefits
- Supports stress reduction through visual and auditory immersion
- Enables intuitive meditation without prior experience
- Enhances motivation through non-intrusive group presence
- Requires no extra sensors beyond standard VR hardware
Technologies
The application was built in Unity (C#) for Meta Quest 3, using Unity Netcode for GameObjects for multiplayer synchronization. Luma, the AI companion, is powered by the ZHAW Narrators and FSM packages, with behavior structured via the xNode visual editor.
Visual feedback includes a pulsing sphere built with Shader Graph and a firefly effect created using the Unity VFX system. Azure KeywordRecognizer and DictationRecognizer enable speech interaction, while spatial audio enhances immersion with ambient nature sounds.
Key terms
- Breathing-Based FeedbackVisualizes the user’s breathing in real time using particles and sphere growth
- Pulsing SphereGuides inhale/exhale rhythm during meditation without verbal instructions
- Firefly SphereGrows in size based on calm breathing, offering intuitive visual progress
- Luma AI CompanionOffers voice guidance and responds to relaxation states using a state machine
- Multiplayer ModeUsers share the same VR scene with synchronized visual feedback, no direct interaction
- Unity NetcodeSynchronizes multiplayer sessions, breathing input, and visual feedback in real time
- Shader GraphUsed to create smooth pulsing animation for the breathing sphere
- Finite State Machine (FSM)Controls Luma’s behavior logic and speech reactions through state transitions
- Spatial AudioImmersive 3D audio used for natural ambient soundscapes (e.g., wind, water)
- Azure Speech RecognitionEnables Luma to listen and respond using KeywordRecognizer and DictationRecognizer
Customer
ZHAW Zürcher Hochschule für Angewandte Wissenschaften
Prof. Dr. Thomas Keller
Gertrudstrasse 15
8401 Winterthur
https://www.zhaw.ch/de/hochschule