Preview for Wan Animate
Wan Animate workflow diagram

Run this workflow on InstaSD

Get started in minutes! Run this ComfyUI workflow online - no setup required.

Description

Wan-Animate is a unified framework that supports two distinct modes:

  1. Animation Mode: Take a static character image and a reference video and animate the character so it mimics the movements/facial expressions from the video.
  2. Replace Mode: In a target video, replace an existing character / subject with a different (animated) character, while preserving lighting, environmental consistency, motion, expressions, etc.

It is built on top of the Wan video generation model.

Wan-Animate is considered a step forward over prior open-source or research animated pipelines because of its unified architecture, higher fidelity & expressiveness, and aseamless blending of the environment and subject. According to multiple benchmarks, Wan-Animate shows superior performance relative to prior animation baselines and is competitive with closed-source systems.

Models

FileDestinationSource
yolox_l.onnx/ComfyUI/custom_nodes/comfyUI_controlnet_aux/ckpts/yzd-v/DWPoseDownload
dw-ll_ucoco_384_bs5.torchscript.pt/ComfyUI/custom_nodes/comfyUI_controlnet_aux/ckpts/hr16/DWPose-TorchScript-BatchSize5Download
sam2_hiera_base_plus.safetensors/ComfyUI/models/sam2Download
WanAnimate_relight_lora_fp16.safetensors/ComfyUI/models/lorasDownload
Wan2_2-Animate-14B_fp8_e4m3fn_scaled_KJ.safetensors/ComfyUI/models/unetDownload
lightx2v_I2V_14B_480p_cfg_step_distill_rank64_bf16.safetensors/ComfyUI/models/lorasDownload
umt5_xxl_fp8_e4m3fn_scaled.safetensors/ComfyUI/models/clip_visionDownload
clip_vision_h.safetensors/ComfyUI/models/clip_visionDownload
wan_2.1_vae.safetensors/ComfyUI/models/vaeDownload

Nodes

GrowMaskSetNodeGetNodeModelSamplingSD3KSamplerCLIPVisionEncodeSaveVideoVAEDecodePreviewImageTrimVideoLatentPrimitiveIntWanAnimateToVideoCLIPTextEncodeDrawMaskOnImageBlockifyMaskMarkdownNoteGetVideoComponentsCreateVideoDWPreprocessorImageFromBatchImageBatchDownloadAndLoadSAM2ModelMaskPreviewSam2SegmentationLoraLoaderModelOnlyUNETLoaderCLIPLoaderCLIPVisionLoaderVAELoaderImageScaleLoadImageLoadVideoPixelPerfectResolutionNotePointsEditor