SVD img2vid Conditioning

Documentation

  • Class name: SVD_img2vid_Conditioning

  • Category: conditioning/video_models

  • Output node: False

This node is designed for generating conditioning data for video generation tasks, specifically tailored for use with SVD_img2vid models. It takes various inputs including initial images, video parameters, and a VAE model to produce conditioning data that can be used to guide the generation of video frames.

Input types

Parameter
Comfy dtype
Description

clip_vision

CLIP_VISION

Represents the CLIP vision model used for encoding visual features from the initial image, playing a crucial role in understanding the content and context of the image for video generation.

init_image

IMAGE

The initial image from which the video will be generated, serving as the starting point for the video generation process.

vae

VAE

A Variational Autoencoder (VAE) model used for encoding the initial image into a latent space, facilitating the generation of coherent and continuous video frames.

width

INT

The desired width of the video frames to be generated, allowing for customization of the video’s resolution.

height

INT

The desired height of the video frames, enabling control over the video’s aspect ratio and resolution.

video_frames

INT

Specifies the number of frames to be generated for the video, determining the video’s length.

motion_bucket_id

INT

An identifier for categorizing the type of motion to be applied in the video generation, aiding in the creation of dynamic and engaging videos.

fps

INT

The frames per second (fps) rate for the video, influencing the smoothness and realism of the generated video.

augmentation_level

FLOAT

A parameter controlling the level of augmentation applied to the initial image, affecting the diversity and variability of the generated video frames.

Output types

Parameter
Comfy dtype
Description

positive

CONDITIONING

The positive conditioning data, consisting of encoded features and parameters for guiding the video generation process in a desired direction.

negative

CONDITIONING

The negative conditioning data, providing a contrast to the positive conditioning, which can be used to avoid certain patterns or features in the generated video.

latent

LATENT

Latent representations generated for each frame of the video, serving as a foundational component for the video generation process.

Last updated