Notes:
Various developers have created a multitude of projects focused on lip synchronization technology and its applications, ranging from converting 2D photos into 3D lip-synced versions, creating photo-realistic lip sync from text, using AI avatars for videos, automatic 2D mouth animation from voice recordings, tools for different platforms like Unity3D, Autodesk Maya, and Blender, and assistive technologies like a mouth-operated joystick for individuals with limited hand function. Additionally, some projects provide solutions for games, animation creation software, and other multimedia integrations.
Resources:
See also:
100 Best Annosoft Lipsync Videos | 100 Best Blender Lipsync Videos | 100 Best Cinema 4D Lipsync Videos | 100 Best Daz3d Lipsync Videos | 100 Best Flash Lipsync Videos | 100 Best Oculus Lipsync Videos | 100 Best Papagayo Lipsync Videos | 100 Best SALSA LipSync Videos | 100 Best ToonBoom Lipsync Videos | 100 Best Unity3d Lipsync Assets | 100 Best Unity3d Lipsync Videos | 100 Best UnrealEngine Lipsync Videos | Automatic Lip Synchronization (Lipsync)
[80x Apr 2025]
- 3d-resume .. an interactive 3d resume project featuring a personalized avatar that answers questions about me. powered by three.js and other cool technologies.
- aienhancedwork .. a collection of ai-driven tools designed to enhance productivity, streamline task automation, and make everyday work more manageable.
- aiwebcam2 .. second attempt at ai webcam, this time with openai api
- akool-talking-avatar-demo .. akool talking avatar demo
- app_rank .. a project to explore app rank data
- arl .. lists of most popular repositories for most favoured programming languages (according to stackoverflow)
- arxiv-cs-analysis .. arxiv cs analysis
- asr-tts-paper-daily .. update asr paper everyday
- avatarlab-g331-ps25 .. repo for avatarlab ps project
- awesome-ai-saas .. list of handy ai gpt tools and apps for every day life
- awesome-airesearch .. collection of ai-related research. welcome to submit issues and pull requests
- awesome-audiovision-multimodal .. a list of current audio-vision multimodal with awesome resources (paper, application, data, review, survey, etc.).
- awesome-computer-vision-paper-list .. this repository contains all the papers accepted in top conference of computer vision, with convenience to search related papers.
- awesome-deepfake-generation-and-detection .. a survey on deepfake generation and detection
- awesome-diffusion-models .. a collection of resources and papers on diffusion models
- awesome-talking-head-generation .. papers for talking head generation, released codes collections.
- awesome-talking-head-synthesis .. an extensive collection of exceptional resources dedicated to the captivating world of talking face synthesis! if you find this repo useful, please give it a star!
- awesome-vrchat .. one-stop shop for people interested in developing content for vrchat
- azure-ai-docs .. open source azure ai documentation including, azure ai, azure studio, machine learning, genomics, open-datasets, and search
- chatbot–tensorflow .. a chatbot created using tensorflow’s sequence to sequence library
- chatdollkit .. chatdollkit enables you to make your 3d model into a chatbot
- cleanup .. a simple command line utility that organises files in a directory into subdirectories
- cognitive-services-speech-sdk .. sample code for the microsoft cognitive services speech sdk
- collected_stars .. a list of all projects that rock my world
- complete_obsolete_guide_ai .. an updated list of generative ai resources
- cvpr-2022 .. papers and code from cvpr 2022, including scripts to extract them
- cvpr-2022-papers .. cvpr 2022 papers
- daily-ai-papers .. all credits go to huggingface’s daily ai papers (https://huggingface.co/papers) and the research community.
- docker-jitsi-meet .. jitsi meet on docker
- documentation .. all gooey.ai workflow guides are here.
- gen-ai-avatars .. this is the best genai avatars that can convert text from llm to an custom voice and face using only 1 image and 1 mins of your voice.
- generative-ai-pharmacist .. generative ai pharmacist (for demo purposes only)
- gptavatarwebgl .. a webgl version of seth robinson’s gptavatar
- heygem.ai .. open source alternative to heygen
- holo-cierge .. transforming guest experiences with a 3d digital concierge!
- i-have-feelings-too .. i have feelings too’ is a bot that analyzes and regularly tweets about the emotion of the twitter public stream.
- ibmdeveloper-recipes .. the repo holds recipes from ibm developer for user access to the information
- iclr2025-papers-with-code .. iclr 2025 papers and open source projects collection
- imbios .. readme of imbios
- iocs .. this repository is for indicators of compromise (iocs) from zscaler threatlabz public reports
- jitsi-meet .. jitsi meet – secure, simple and scalable video conferences that you use as a standalone app or embed in your web application.
- linly-talker .. digital avatar conversational system – linly-talker.
- livetalking .. real time interactive streaming digital human
- llama-factory .. unified efficient fine-tuning of 100+ llms & vlms (acl 2024)
- m5stack-avatar .. an m5stack library for rendering avatar faces
- mediapipe .. cross-platform, customizable ml solutions for live and streaming media.
- mediapipe4u-plugin .. An Unreal Engine plugin that helps you use AI and ML techniques in your unreal engine project.
- metahumansdk_pixelstreaming_chat .. metahuman sdk pixel streaming sample
- ml .. machine learning – collection of my personal user machine learning libraries/experiments
- ml_in_gamedev .. machine learning applications in game development
- mumble-record .. a temporary branch to implement recording in mumble
- nvidia-human-ai-lipsync .. this project is a digital human that can talk to you and is animated based on your questions. it uses the nvidia api endpoint meta llama3-70b to generate responses, eleven labs to generate voice and rhubarb lip sync to generate the lip sync.
- openai .. openai scholar, general materials
- opentalker-sadtalker .. sadtalker
- parscit .. an open-source crf reference string parsing package
- privacy-risk-mhealth .. ui for paper “an information privacy index for mhealth apps”
- prmumble .. project reality’s mumble fork for battlefield 2 in-game voip replacement with positional audio
- project_maria_accelerator_tts .. ai-driven custom avatar gbb agent
- python_ml_workouts .. workouts
- realchatpaper .. chatpaper
- remotion .. make videos programmatically with react
- sadt .. sadtalker
- sms-spam-classifier- .. a weka based sms spam classifier
- speech-and-audio-papers-top-conference .. iclr2023-2025, icml2023-2024, neurips2023-2024, acmmm2024, aaai2024, acl2024, emnlp2024, naacl2025
- spell-and-speak .. In sp?l ænd spik I hand over the composition of these phonemes to a computer program and text-to-speech software.
- starman .. repo that acts as an awesome list of all my starred repositories.
- talking-avatar-with-ai .. this project is a digital human that can talk and listen to you. it uses openai’s gpt to generate responses, openai’s whisper to transcript the audio, eleven labs to generate voice and rhubarb lip sync to generate the lip sync.
- talking-face-arxiv-daily .. update talking-face research papers daily, now integrated with llm analysis.
- talkinghead .. a javascript class for real-time lip-sync using ready player me full-body 3d avatars.
- tastt .. a free self-hosted stt for vrchat
- tiktok-brand-sentiment-analysis .. brand perspective and sentiment analysis on the brand tiktok
- til .. things i learned
- ulipsync .. mfcc-based lipsync plug-in for unity using job system and burst compiler
- video-generation-survey .. a reading list of video generation
- vocal.ai .. is an innovative application that allows users to input text and receive a custom-generated video of a person saying that text.
- voicetuber .. vtuber application which only requires your voice and microphone, no need for a webcam or other tracking nonsense.
- wav2lip .. wav2lip
- whisper_client .. whisper voice client
- winget-pkgs-index .. open-source package index of windows package manager repository
- youtube-avatar-video-generator .. sadtalker