Escom Develops Virtual Singing Training App

Reporter: Rocío Castañeda / Photographer: Javier González — August 3, 2026

Students create a virtual reality platform that provides users with immediate feedback

Students from the School of Computer Science (Escom) developed a virtual reality platform that combines singing training, keyboard practice, and the simulation of an interactive virtual audience. The system provides users with an immersive experience while delivering real-time feedback on their performance.

The combination of technology, innovation, and a passion for music led Instituto Politécnico Nacional (IPN) students Víctor Manuel Aguirre Lanto and Juan Fernando León Medellín to develop the project titled “Virtual Reality System for Musical Training and Performance,” which earned them their degrees in Computer Systems Engineering.

The polytechnic students explained that the technological tool combines virtual reality (VR) and Musical Instrument Digital Interface (MIDI) technology, allowing users to practice singing or keyboard performance in an immersive environment that simulates the experience of performing live. This helps build confidence and strengthen their performance skills.

Their capstone project, which won first place in the Hybrid Systems category at Expo Escom 2026, uses digital audio processing techniques to compare the user's performance in real time. It also incorporates a pitch-correction algorithm developed in Python that analyzes the voice using spectral analysis techniques and determines deviations from the target note.

Under the supervision of professors Martha Margarita Dorantes Cordero and Saúl De La O Torres, Víctor Manuel Aguirre Lanto and Juan Fernando León Medellín used animation tools and Artificial Intelligence (AI) to create an immersive virtual environment featuring an audience capable of reacting either through predefined responses or adaptively, depending on the user's performance.

The two polytechnic students, who are also members of the musical band Vidrio Lunar, combined their artistic experience with their technological skills to enhance the project. The platform is intended for musicians, students, and anyone seeking to improve their musical abilities while developing strategies to manage stage fright by practicing in a controlled environment.

To implement the platform, Aguirre Lanto and León Medellín developed advanced algorithms to analyze the voice, integrated MIDI hardware for musical interaction, and designed immersive virtual reality environments to provide an accurate, realistic, and engaging experience.

The system features an intuitive interface that displays the available repertoire, allows users to select different levels of virtual audience intensity, and records performance statistics. Users can review their practice results, including scores for pitch and rhythm, as well as harmony when playing the keyboard.

Engineer Saúl De La O Torres emphasized that digital signal processing was fundamental to the project, requiring advanced mathematical techniques to extract information related to the voice, rhythm, and pitch.

Professor Martha Dorantes noted that the project provides a comprehensive approach to musical training and highlighted its innovative use of technology to support both artistic development and learning.