Run this workflow on InstaSD
Get started in minutes! Run this ComfyUI workflow online - no setup required.
Description
Wan-Animate is a unified framework that supports two distinct modes:
- Animation Mode: Take a static character image and a reference video and animate the character so it mimics the movements/facial expressions from the video.
- Replace Mode: In a target video, replace an existing character / subject with a different (animated) character, while preserving lighting, environmental consistency, motion, expressions, etc.
It is built on top of the Wan video generation model.
Wan-Animate is considered a step forward over prior open-source or research animated pipelines because of its unified architecture, higher fidelity & expressiveness, and aseamless blending of the environment and subject. According to multiple benchmarks, Wan-Animate shows superior performance relative to prior animation baselines and is competitive with closed-source systems.
Models
| File | Destination | Source |
|---|---|---|
| yolox_l.onnx | /ComfyUI/custom_nodes/comfyUI_controlnet_aux/ckpts/yzd-v/DWPose | Download |
| dw-ll_ucoco_384_bs5.torchscript.pt | /ComfyUI/custom_nodes/comfyUI_controlnet_aux/ckpts/hr16/DWPose-TorchScript-BatchSize5 | Download |
| sam2_hiera_base_plus.safetensors | /ComfyUI/models/sam2 | Download |
| WanAnimate_relight_lora_fp16.safetensors | /ComfyUI/models/loras | Download |
| Wan2_2-Animate-14B_fp8_e4m3fn_scaled_KJ.safetensors | /ComfyUI/models/unet | Download |
| lightx2v_I2V_14B_480p_cfg_step_distill_rank64_bf16.safetensors | /ComfyUI/models/loras | Download |
| umt5_xxl_fp8_e4m3fn_scaled.safetensors | /ComfyUI/models/clip_vision | Download |
| clip_vision_h.safetensors | /ComfyUI/models/clip_vision | Download |
| wan_2.1_vae.safetensors | /ComfyUI/models/vae | Download |
Nodes
GrowMaskSetNodeGetNodeModelSamplingSD3KSamplerCLIPVisionEncodeSaveVideoVAEDecodePreviewImageTrimVideoLatentPrimitiveIntWanAnimateToVideoCLIPTextEncodeDrawMaskOnImageBlockifyMaskMarkdownNoteGetVideoComponentsCreateVideoDWPreprocessorImageFromBatchImageBatchDownloadAndLoadSAM2ModelMaskPreviewSam2SegmentationLoraLoaderModelOnlyUNETLoaderCLIPLoaderCLIPVisionLoaderVAELoaderImageScaleLoadImageLoadVideoPixelPerfectResolutionNotePointsEditor