Explore the text-to-image workflow in SeaArt's ComfyUI, from adding nodes like KSampler and LoRA to setting parameters and generating stunning images based on your text prompts.
1. Understanding the Text to Image Workflow
start by clicking on ComfyUI, create a new ComfyUI workflow
add the basic workflow for Text to Image
The workflow in ComfyUI is similar to that in Web UI:
select a model → enter prompt → set parameters → generate image
Parameters
control_after_generate: control over seed generation
fixed: fixing the seed
increment: adding 1 from the existing seed
decrement: subtracting 1 from the existing seed
randomize: random seed
scheduler: usually choose between normal or karras denoise: which indicates the strength of noise reduction in image generation, the higher the value, the greater the impact and change on the image
size recommendation:
SD1.5: 512512
SDXL: 10241024
2. How to add a node?
Add KSampler
First, add a core node: the KSampler
Right-click: Add Node → sampling → KSampler
Pull out the node
then pull out the sampler node and add the corresponding nodes
model→CheckpointLoaderSimple
positive→CLIPTextEncode
negative→CLIPTextEncode
latent_image→EmptyLatentImage
LATENT→VAEDecode
IMAGE→SaveImage
How to add LoRA?
Loaders: mainly used for loading the diffusion model, including model and LoRA.
Add Node→loaders→Load LoRA
How to add Clip Skip?
Conditioning: guides the diffusion model to generate specific outputs, including Prompt, ControINet, Clip Skip, etc.
It is recommended to add Clip Skip to control the layers skipped, which helps adjust the final image details.
Add Node→conditioning→CLIP Set Last Layer
Connect nodes
After adding nodes, many nodes might not be connected yet. They need to be connected in order according to the sequence and matching colors.
