SeaArt ComfyUI WIKI
  • SeaArt ComfyUI WIKI
  • Core Nodes
    • Advanced
      • conditioning
        • CLIP Text Encode SDXL
        • CLIP Text Encode SDXL Refiner
        • Conditioning Set Timestep Range
        • Conditioning Zero Out
        • Flux
          • CLIPTextEncodeFlux Node for ComfyUI Explained
          • FluxGuidance - ComfyUI Node Functionality Description
      • Loaders
        • Load CLIP
        • Load Checkpoint With Config (DEPRECATED)
        • Diffusers Loader
        • Dual CLIP Loader - How it work and how to use it
        • UNET Loader Guide | Load Diffusion Model
      • Model
        • Model Sampling Continuous EDM
        • Model Sampling Discrete
        • Rescale CFG
      • Model-merging
        • Checkpoint Save
        • CLIPMerge Simple
        • CLIP Save
        • Model Merge Add
        • Model Merge Blocks
        • Model Merge Simple
        • Model Merge Subtract
        • VAE Save
    • Conditioning
      • 3d-models
        • Stable Zero 123 Conditioning
        • Stable Zero 123 Conditioning Batched
      • CLIP Set Last Layer
      • CLIP Text Encode (Prompt)
      • CLIP Vision Encode
      • Conditioning Average
      • Conditioning (Combine)
      • Conditioning (Concat)
      • Conditioning (Set Area)
      • Conditioning (Set Area with Percentage)
      • Conditioning Set Area Strength
      • Conditioning (Set Mask)
      • Apply ControlNet
      • Apply ControlNet (Advanced)
      • gligen
        • GLIGEN Text Box Apply
      • inpaint
        • Inpaint Model Conditioning
      • style-model
        • Apply Style Model
      • unCLIP Conditioning
      • upscale-diffusion
        • SD_4X Upscale Conditioning
      • video-models
        • SVD img2vid Conditioning
    • Image
      • animation
        • Save Animated PNG
        • Save Animated WEBP
      • batch
        • Image From Batch
        • Rebatch Images
        • Repeat Image Batch
      • Empty Image
      • Batch Images
      • Image Composite Masked
      • Invert Image
      • Pad Image for Outpainting
      • Load Image
      • postprocessing
        • Image Blend
        • Image Blur
        • Image Quantize
        • Image Sharpen
      • preprocessors
        • Canny Node
      • Preview Image
      • Save Image
      • transform
        • Image Crop
      • upscaling
        • Upscale Image
        • Upscale Image By
        • Image Scale To Total Pixels
        • Upscale Image (using Model)
    • Latent
      • Latent Upscale
      • Empty Latent Image
      • Latent Upscale By
      • Latent Composite
      • VAE Decode
      • VAE Encode
      • Latent Composite Masked
      • advanced
        • Latent Add
        • Latent Batch Seed Behavior
        • Latent Interpolate
        • Latent Multiply
        • Latent Subtract
      • batch
        • Latent Batch
        • Latent From Batch
        • Rebatch Latents
        • Repeat Latent Batch
      • inpaint
        • Set Latent Noise Mask
        • VAE Encode (for Inpainting)
      • transform
        • Crop Latent
        • Flip Latent
        • Rotate Latent
    • Loaders
      • Checkpoint Loader (Simple)
      • CLIP Vision Loader
      • ControlNet Loader
      • Diff ControlNet Loader
      • GLIGEN Loader
      • Hypernetwork Loader
      • Lora Loader
      • Lora Loader Model Only
      • Style Model Loader
      • unCLIP Checkpoint Loader
      • Upscale Model Loader
      • VAE Loader
      • video-models
        • Image Only Checkpoint Loader (img2vid model)
    • Mask
      • compositing
        • Join Image with Alpha
        • Porter-Duff Image Composite
        • Split Image with Alpha
      • Crop Mask
      • Feather Mask
      • Grow Mask
      • Image Color To Mask
      • Image To Mask
      • Invert Mask
      • Load Image (as Mask)
      • Mask Composite
      • Mask To Image
      • Solid Mask
    • Sampling
      • custom-sampling
        • SamplerCustom
        • samplers
          • KSampler Select
          • Sampler DPMPP_2M_SDE
          • Sampler DPMPP_SDE
        • schedulers
          • Basic Scheduler
          • Exponential Scheduler
          • Karras Scheduler
          • Polyexponential Scheduler
          • SD Turbo Scheduler
          • VP Scheduler
        • sigmas
          • Flip Sigmas
          • Split Sigmas
      • KSampler
      • KSampler (Advanced)
      • Sampler
      • video-models
        • Video Linear CFG Guidance
    • Utils
      • Note
      • Primitive
      • Reroute
      • Terminal Log (Manager)
  • ComfyUI Workflow Example
    • 1-Img2Img
    • 2-2 Pass Txt2Img
    • 3-Inpaint
    • 4-Area Composition
    • 5-Upscale Models
    • 6-LoRA
    • 7-ControlNet
    • 8-Noisy Latent Composition
    • 9-Textual Inversion Embeddings
    • 10-Edit Models
    • 11-Model Merging
    • 12-SDXL
    • 13-Stable Cascade
    • 14-UnCLIP
    • 15-Hypernetworks
    • 16-Gligen
    • 17-3D Examples
    • 18-Video
    • 19-LCM Examples
    • 20-ComfyUI SDXL Turbo Examples
  • How to publish as an AI app
  • FAQ (Must see!!!)
Powered by GitBook
On this page
  • Image to Video
  • Some explanations for the parameters:
  1. ComfyUI Workflow Example

18-Video

Previous17-3D ExamplesNext19-LCM Examples

Last updated 4 months ago

Image to Video

The most basic way of using the image to video model is by giving it an init image like in the following workflow that uses the 14 frame model. You can download this webp animated image and load it or drag it on to get the workflow.

You can also use them like in this workflow that uses SDXL to generate an initial image that is then passed to the 25 frame model:

Some explanations for the parameters:

video_frames: The number of video frames to generate.

motion_bucket_id: The higher the number the more motion will be in the video.

fps: The higher the fps the less choppy the video will be.

augmentation level: The amount of noise added to the init image, the higher it is the less the video will look like the init image. Increase it for more motion.

VideoLinearCFGGuidance: This node improves sampling for these video models a bit, what it does is linearly scale the cfg across the different frames. In the above example the first frame will be cfg 1.0 (the min_cfg in the node) the middle frame 1.75 and the last frame 2.5. (the cfg set in the sampler). This way frames further away from the init frame get a gradually higher cfg.

If you want the exact input image you can find it on the

Workflow in Json format
unCLIP example page
Workflow in Json format Json
ComfyUI