#pixivnet #openaicom #githubcom
**ChatVRM: Open-source Interactive 3D Character Technology Utilizing OpenAI API for Real-time Conversations in Web Browsers **
ChatVRM is an open-source technology that enables interaction with 3D characters through web browsers, integrating artificial intelligence with 3D character technology. It utilizes OpenAIâ??s API, allowing users to talk to virtual characters, and operates primarily in TypeScript. Users can import VRM files to communicate with the characters via text or voice in real-time. Several applications have utilized ChatVRM technology, demonstrating its usage in virtual interactions and conversations, notably with characters like Melissa on VRChat. Its functionality can be extended by adding the ChatGPT API key, which is distributed by OpenAI.
Pixiv has publicly disclosed the source code of ChatVRM, and the primary programming language for ChatVRM is TypeScript, making it accessible for developers to modify or adapt. It has been used in various applications and demonstrations, such as virtual avatars and VTuber platforms. Users can interact with the system using microphones, text input, and speech synthesis, providing a versatile approach to virtual interaction.
The technology also leverages Web Speech API for speech recognition and utilizes other services like Koemotion/Koeiromap API for generating 3D character displays. Various functionalities of ChatVRM are highlighted in technology demonstrations, where characters respond to spoken or written words with full voice, and it is operable on web browsers.
The system allows integration with other projects, and can be used in varied platforms like VRChat and OpenCharacters. It can be utilized for different use cases such as practicing interviews, having conversations, and more interactive activities with 3D avatars. Access to the API may be subject to change, and API endpoints may break without prior notice, hence users and developers are encouraged to keep this in consideration while using ChatVRM.
Despite the extensive application of ChatVRM in interactive technology, users should be mindful of potential disruptions or alterations in API access, and developers are encouraged to use the open-source provision for modifications and enhancements in alignment with project requirements.
https://github.com/pixiv/ChatVRM
https://github.com/pixiv/ChatVRM