Tools

ComfyUI-CogVideoXWrapper: Advanced Video Generation Tool

Comprehensive wrapper for CogVideoX models in ComfyUI, supporting CogVideoX 1.5, Fun models, and Go-with-the-Flow LoRA integration.

By ltx workflow

Editor's Note: This tool provides advanced CogVideoX integration for ComfyUI, offering support for multiple model versions and specialized features like Go-with-the-Flow motion control.

ComfyUI-CogVideoXWrapper: Advanced Video Generation Tool

ComfyUI-CogVideoXWrapper is a comprehensive integration tool that brings CogVideoX models into ComfyUI with extensive feature support and workflow flexibility.

Key Features

CogVideoX 1.5 Support

The wrapper now supports the latest CogVideoX 1.5 models, providing improved video quality and generation capabilities compared to earlier versions.

Fun Model Integration

Major functionality merge brings Fun model support into the main pipeline:

  • All Fun-specific nodes (except image encode for Fun-InP models) have been consolidated
  • Main CogVideo Sampler works seamlessly with Fun models
  • DimensionX LoRAs now compatible with Fun models

Go-with-the-Flow Support

Preliminary support for Go-with-the-Flow motion control using LoRA weights. This feature enables:

  • Advanced motion warping capabilities
  • Cut and drag video creation workflows
  • NoiseWarp processing for enhanced motion control

LoRA weights available at: https://huggingface.co/Eyeline-Research/Go-with-the-Flow/tree/main

Technical Improvements

Code Cleanup and Refactoring

Major code cleanup improves maintainability and performance. Note: This update breaks compatibility with old workflows - users should migrate to new workflow formats.

Dynamic Dimension Detection

Width and height are now detected from input rather than sampler widgets. Text-to-video workflows now require using empty latents for proper dimension handling.

Supported Models

A comprehensive spreadsheet tracks supported models and their features: https://docs.google.com/spreadsheets/d/16eA6mSL8XkTcu9fSWkPSHfRIqyAKJbR1O99xnuGdCKY/edit?usp=sharing

Workflow Examples

Example workflows are provided in the example_workflows folder, covering:

  • Basic text-to-video generation
  • Image-to-video conversion
  • Go-with-the-Flow motion control
  • Cut and drag video creation

Installation

Install via ComfyUI Manager or clone the repository into your ComfyUI custom_nodes directory:

git clone https://github.com/kijai/ComfyUI-CogVideoXWrapper

Legacy Support

Old version maintained in legacy branch for users who need backward compatibility, though it is no longer actively maintained.

Sources

#cogvideox#comfyui#video-generation#wrapper#tool