Lip sync

6 entries tagged lip sync, newest first.

Filter: categories and tools

Categories

Tools

Show all 45 tools
All tools with counts >
  • Open ComfyUI workflow turns text into a lip-synced talking video with Drama 3 and MiniMax H3

    A free ComfyUI workflow from Skysay chains Fish Audio Drama 3 for expressive speech with MiniMax H3 for a lip-synced talking video, all on your own GPU. It ships as MIT-licensed graphs plus a script that runs both stages.

    drama3-h3-talking3 sources · github.com
  • Kandinsky 6.0 Video released as open audio-video model

    Kandinsky 6.0 Video generates five-second clips with matching sound, including lip-synced speech, from text or an image. The Lite and Pro models, code and weights are released under the MIT license.

    Kandinsky 6.0 Video1 source · arxiv.org
  • Sync Lipsync v3 available on Artlist

    Sync Lipsync v3 re-renders the mouth in existing footage or a still image to match a new audio track, up to 4K. It holds sync on profile angles and when hands or mics block the mouth.

    Sync Lipsync v31 source · help.artlist.io
  • Nvidia expands AI for Media with lip sync and 8K upscaling

    Nvidia's AI for Media toolkit for broadcasters adds frame generation for slow motion, 8K upscaling and SDR-to-HDR conversion. It also adds real-time lip sync to translated audio and speaker detection.

    Nvidia AI for Media1 source · digitaltoday.co.kr
  • Beeble SwitchX 2.0 video-to-video update

    SwitchX 2.0 lets filmmakers and VFX artists swap elements in real footage, now with native 4K, 20-second shots and 10-bit color. It also improves camera tracking and lip sync and adds an up-res finishing workflow.

    Beeble SwitchX 2.01 source · provideocoalition.com
  • LipDub 2.0 speeds up short-form localization

    LipDub 2.0 is a new lip sync model with no training step, making it 8x faster than LipDub 1.0. It handles single-speaker videos up to 2 minutes at 1080p in 80+ languages.

    LipDub 2.01 source · lipdub.ai

Questions and answers

What is the best local AI lip sync tool?

Among the entries here, Kandinsky 6.0 Video is the open-weight option: it generates lip-synced speech with the video under the MIT license. For audio-driven talking video in ComfyUI, see the Wan2.2-S2V guide.

Which AI lip sync tool is good for dubbing and localization?

LipDub 2.0 focuses on short-form localization with no training fees, and Sync Lipsync v3 is available on Artlist. Sync Lipsync v3 needs an audio file and has no text prompt.

Does lip sync need an audio file?

For Sync Lipsync v3, yes: audio is required and outputs are MP4. Audio-video models like Kandinsky 6.0 Video instead generate the speech themselves.

Can I make a talking-head video with open models on my own GPU?

Yes: the free drama3-h3-talking ComfyUI workflow turns text into speech with Fish Audio Drama 3, then drives a lip-synced MiniMax H3 video from a face image. Its author measured about 130 to 190 seconds for the video stage of a 7 to 9 second clip on a 96 GB card, and both models have community licenses to check first.