Revolutionizing AI-Generated Content: NVIDIA's Cosmos Integrates with ComfyUI

CN
ComfyUI.org
2025-03-12 10:24:05

Recently, NVIDIA announced the official integration of its AI world model, Cosmos, into the ComfyUI platform, a development that has caused a significant stir in the AI community.

What does this mean?

  • Enhanced AI Creative Capabilities: Cosmos, as an advanced AI world model, is capable of understanding and generating realistic 3D scenes and objects. With its integration into ComfyUI, users can leverage the powerful features of Cosmos to more easily create complex AI-generated content within ComfyUI's visual node-based operational interface.

  • Lowered Barriers to Entry: ComfyUI is renowned for its ease of use and flexibility, allowing even beginners to quickly get started. The integration of Cosmos brings the formidable capabilities of AI world models to a broader user base, reducing the entry threshold.

  • Broader Application Prospects: From game development and film production to architectural and industrial design, the combination of Cosmos and ComfyUI will bring revolutionary changes to various fields, propelling the application of AI-generated content to new heights.

How to Use?

  1. Update ComfyUI

    • Simply update the ComfyUI kernel to the latest version.

  2. Download the Three Essential Models

    • Large Model

    • CLIP

    • VAE

    Large Model (place in the models/unet directory)

    • It is recommended to use the 7B version (requires 22GB of video memory).

    • The 14B version demands even more video memory.

    m85rs8wv6szi0qqltvy1.png


    Download this 7B model.

    m85rsh7puom51b4cypb2.png

    CLIP Model (place in the models/clip directory)

    • The fp8 version is recommended.

    • It is more video memory-efficient than the fp16 version.

    m85rt2zl6kgt3fl4crd3.pngm85rt87brq5m4cw89v4.png

    VAE Model (place in the models/vae directory)

    • cosmos_cv8x8x8_1.0.safetensors

    m85rtdq6o5bb581xl6k5.pngm85rticylpbirtvnkmf6.png
  3. Model Download Links

Future Outlook

The integration of NVIDIA Cosmos with ComfyUI marks another significant step forward in the field of AI-generated content. With the continuous advancement of technology, AI is expected to create even more astonishing works in the future, offering limitless possibilities for humanity.