Popular GitHub Repositories for Lipsync

Industry leading face manipulation platform

Taming Stable Diffusion for Lip Sync!

移动版二次元 AI 老婆聊天器

Industry leading face manipulation platform

DeepFuze is a state-of-the-art deep learning tool that seamlessly integrates with ComfyUI to revolutionize facial transformations, lipsyncing, Face Swapping, Lipsync Translation, video generation, and voice cloning.

Industry leading face manipulation platform

This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.

lipsync is a simple and updated Python library for lip synchronization, based on Wav2Lip. It synchronizes lips in videos and images based on provided audio, supports CPU/CUDA, and uses caching for faster processing.

Full version of wav2lip-onnx including face alignment and face enhancement and more...

Wav2Lip UHQ Improvement with ControlNet 1.1

Simple and fast wav2lip using new 256x256 resolution trained onnx-converted model for inference. Easy installation

simple and fast wav2lip using onnx models for face-detection and inference. Easy installation

Zippy Talking Avatar uses Azure Cognitive Services and OpenAI API to generate text and speech. It is built with Next.js and Tailwind CSS. This avatar responds to user input by generating both text and speech, offering a dynamic and immersive user experience

DoyenTalker uses deep learning techniques to generate personalized avatar videos that speak user-provided text in a specified voice. The system utilizes Coqui TTS for text-to-speech generation, along with various face rendering and animation techniques to create a video where the given avatar articulates the speech.

通過少量語音與影片樣本生成高質量的語音與影片克隆 ( AI 人像口白生成 )，並提供多種音頻處理技術來提升音質和真實感。

Generative AI | Automated Video Translation and Content Generation using Talking Heads, Leveraging Wav2Lip Model

A multi-language virtual assistant

使用Rhubarb Lip Sync、Whisper AI转录和FFmpeg，自动创建与音频同步的视频。支持带自定义背景的MP4和带透明度的MOV格式。轻松自定义嘴部图像，支持GPU加速，设置简单。

The LipSync-Wav2Lip-Project repository is a comprehensive solution for achieving lip synchronization in videos using the Wav2Lip deep learning model. This open-source project includes code that enables users to seamlessly synchronize lip movements with audio tracks.

A Google Colab-based Gradio app for generating lip-synced videos using the Sonic model. It supports audio-to-video syncing with Hugging Face models and runs entirely in the cloud—no local setup needed.