#changlabucsfedu #speech_graphicscom
In this project, Speech Graphics technology, originally developed for creating realistic facial animations in video games, was repurposed and utilized in two significant ways:
1. **Voice-Driven Animation**: The AI system of Speech Graphics was used to analyze a synthesized voice derived from the patient’s brain signals. By analyzing this voice, the technology could reverse-engineer and simulate the complex muscle movements of the face, tongue, and jaw that would naturally occur while producing the sound. This process enabled the digital avatar to produce accurate facial movements, including speech articulations, synchronized with the synthesized voice.
1. **Direct Brain Signal to Facial Animation**: In a more direct and groundbreaking approach, the technology was also adapted to use the patient’s brain signals to drive the simulated facial muscles directly, bypassing the need for a synthesized voice intermediary. This method allowed the avatar to reflect specific emotions and individual muscle movements as intended by the patient’s brain signals.
https://www.speech-graphics.com/news/video-game-technology-helps-paralysed-woman-speak-again