#fokusfraunhoferde
The project titled “**The MetaHuman Virtual Assistant**,” developed for the Advanced Web Technologies course at Technische Universität Berlin in collaboration with the Fraunhofer Fokus Institute, is demonstrated in this presentation. The project’s goal is to design a virtual training environment using MetaHuman models. The assistant, based on OpenAI’s ChatGPT, can interact with the environment, providing information on various subjects, such as anatomy. The technology stack used includes Unreal Engine 5.1, OpenAI’s Whisper for speech-to-text, Microsoft Azure Cognitive Services for text-to-speech, and MetaHuman SDK Plugin for lip-sync. It illustrates the cost-effectiveness, risk mitigation, and high interactivity offered by virtual training. This work was carried out by Emil Balitzki, Tarek El Tamimi, and Mehmet Karagülle, supervised by Dr. Louay Bassbouss.