Interactive visualization of singing
An innovative 4-player audio-controlled game using real-time pitch & volume. Collect fruits with your voice for an engaging, uniquely musical experience.
Summary
Our project is an innovative four-player audio-controlled game where each player uses their voice's pitch and volume to navigate and collect fruits moving across the screen. Combining real-time audio processing with engaging gameplay, the game offers a unique multiplayer experience that challenges your vocal control and coordination.
Features
- Real-time audio pitch and volume detection.
- Multiplayer support for up to four players.
- Visually appealing and responsive game environment.
- Easy setup and user-friendly controls.
Gameplay
In our Fruit Collector Audio Game, you control the movement of your character entirely by your voice. Louder volume propels your character upward, while softer volume gently lowers it. Additionally, changing your pitch will move you from left to right. Mastering the combination of pitch and volume is key to maneuvering your character around the screen, dodging obstacles, and collecting as many fruits as possible within the time limit. The more fruits you snag, the higher your final score!
Screenshot 1
Screenshot of the Game itself, up to four players can move their figures with their voice and can collect fruits. In the corner is the current score and the remaining time
Screenshot 2
Final score after the game. Each player can see their own score which are also color coded
Screenshot 3
Sound waves of each player as well as the moment they collected their fruit. Informations about their highest and lowest pitch can also be found there
Technologies
Our project leverages powerful technologies to deliver a seamless and engaging gaming experience. Python serves as the backbone, while Pygame handles the game development aspects. PyAudio facilitates real-time audio processing to capture pitch and volume variations on the fly. Through these robust and well-supported libraries, we’ve built a unique game that merges vocal control with interactive visuals.
Key terms
- Real-Time AudioProcesses incoming voice data instantly for smooth gameplay
- Voice ControlAdjust pitch and volume to navigate and collect fruits
- Pitch DetectionAnalyzes vocal frequency to move characters horizontally
- Volume AnalysisMeasures loudness to handle vertical movement
- MultiplayerSupports up to four players singing simultaneously
Customer
Professur für Musikpädagogik im Jugendalter, Pädagogische Hochschule FHNW
Gabriel Imthurn
Bahnhofstrasse 6
5210 Windisch
Link
Team
Marco Worni
Luca Bertonazzi
Advisor
Kevin Kim