wan-multitalk

Featured

Build WAN MultiTalk audio-driven talking-avatar / lip-sync video workflows. MeiGen-AI MultiTalk on WAN 2.1 14B I2V via kijai WanVideoWrapper (portrait + audio → lip-synced video)

AI & Automation 738 stars 120 forks Updated yesterday MIT

Install

View on GitHub

Quality Score: 91/100

Stars 20%
96
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# WAN MultiTalk — Audio-Driven Talking Avatar ## Overview MultiTalk (MeiGen-AI) drives a still portrait's lip-sync and head motion from an audio track. It runs on WAN 2.1 14B Image-to-Video via kijai's ComfyUI-WanVideoWrapper. Wav2Vec speech embeddings condition the WAN sampler so the mouth and expression follow the speech, while the lightx2v step-distill LoRA keeps it to a few sampling steps. Use it for talking heads, dubbing, and single-speaker avatar clips (~10s at 480p). It is distinct from `wan-animate` (pose/motion-driven character animation). This is audio → lip-sync, not reference-video motion transfer. Pack: `wan-multitalk` (480p, ~10s). Higher-res/longer variants exist in the source bundle (720p, long-context) as VRAM/duration knobs on the same graph. ## Pipeline (node graph) ``` LoadImage (portrait) ─┐ LoadAudio ─ AudioSeparation ─ AudioCrop ─ DownloadAndLoadWav2VecModel ─ MultiTalkWav2VecEmbeds ─┐ ▼ WanVideoModelLoader (WAN 2.1 14B I2V GGUF) ─ MultiTalkModelLoader ─ WanVideoLoraSelect (lightx2v) + LoadWanVideoT5TextEncoder (umt5) + WanVideoTextEncode + WanVideoClipVisionEncode (clip_vision_h) + WanVideoVAELoader ──────────────────────────────────────────────────────────────────────────┘ ▼ WanVideoImageToVideoMultiTalk ─ WanVideoSampler ─ WanVideoDecode ─ VHS_VideoCombine ``` Key no...

Details

Author
artokun
Repository
artokun/comfyui-mcp
Created
6 months ago
Last Updated
yesterday
Language
TypeScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category