Unlock Liquid Magic: Advanced I2V Workflow for Stunning Visual Effects

CN
ComfyUI.org
2025-05-09 08:29:50

1. Workflow Overview

magjby5bjbu668acqms3307362b665ba4475ae5aa50fd81f0bd7c44db4c9d791fe94f0d49861cd9db88.gif

This workflow is designed for Image-to-Video (I2V) generation, specializing in simulating liquid collision and splash effects (e.g., purple TV with transparent liquid). It combines WanVideo's custom models with GIMM-VFI frame interpolation, outputting MP4 videos or GIFs.


2. Core Models

  • Wan2.1-I2V-14B:

    • Function: Generates video latent from images (720P support).

    • Source: Download Wan2_1-I2V-14B-720P_fp8_e4m3fn.safetensors (BF16 precision).

  • UMT5-XXL Text Encoder:

    • Encodes Chinese prompts (e.g., "liquid splash") into embeddings.

    • Source: umt5-xxl-enc-bf16.safetensors.

  • GIMM-VFI Model:

    • Enhances video smoothness via frame interpolation. Requires gimmvfi_r_arb_lpips_fp32.safetensors.


3. Key Nodes

Node Name

Function

Installation

WanVideoBlockSwap

Optimizes VRAM via block swapping

Install ComfyUI-WanVideoWrapper

WanVideoLoraSelect

Loads LoRA (e.g., liquid effects)

Same as above

GIMMVFI_interpolate

Frame interpolation for videos

Requires ComfyUI-GIMM-VFI

VHS_VideoCombine

Renders frames to MP4/GIF

Install ComfyUI-VideoHelperSuite


4. Workflow Groups

  • Group 1: Model & Encoder Loading

    • Input: Model files, LoRA, text encoder.

    • Output: Initialized models.

  • Group 2: Text & Image Encoding

    • Input: Chinese prompts + image (1024x1440 PNG).

    • Output: Text/image embeddings.

  • Group 3: Video Generation & Interpolation

    • Input: Embeddings + seed (e.g., 1032809127571661).

    • Output: Interpolated frames (272x272).


5. Inputs & Outputs

  • Required Inputs:

    • Image: Clear subject (e.g., TV) with simple background.

    • Prompts: Positive (e.g., "transparent liquid splash"), negative (e.g., "color change").

    • Seed: Fixed (e.g., 1032809127571661) or randomized.

  • Output:

    • Default: MP4 (NVENC H.264, 30FPS), optional GIF.


6. Notes

  1. Hardware:

    • ≥12GB VRAM (RTX 3090+ recommended) due to UMT5-XXL and Wan2.1 model size.

  2. Troubleshooting:

    • VRAM errors: Reduce resolution or disable teacache_args optimization.

    • Missing nodes: Install ComfyUI-WanVideoWrapper and ComfyUI-GIMM-VFI.

  3. LoRA:

    • Download WAN2.1 ZOEY Liquid Splash_Alpha.safetensors, set weight=1.0.