SeaArt Guide
How to SeaArt AI - Office Tutorial
How to SeaArt AI - Office Tutorial
  • ✨How to Use an AI Image Generator
  • ✨1-SeaArt AI Basic Page
  • ✨2-SeaArt AI Basic Function
    • 2-1 Text to Image
    • 2-2 Image to Image
    • 2-3 ControlNet
    • 2-4 AI Apps
      • How to publish as App
      • Swift AI Apps
    • 2-5 AI Characters
      • How to create your own character?
      • Character Description Writing Tips
      • Conversation Tips
    • 2-6 Models
    • 2-7 Post
    • 2-8 AI Video Generation
      • Txt2Vid
      • Img2Vid
      • Camera Movement
      • Start and End Frames
    • 2-9 AI Audio
    • 2-10 Workflow
      • Text to Image Workflow
      • IMG2IMG+Partial Repainting
      • Core Nodes
      • Tips
    • 2-11 Canvas
    • 2-12 LoRA Training
      • Flux Lora Training
  • ✨3-Advanced Guide
    • 3-1 Principles of AI art
    • 3-2 LoRA Training (Advance)
      • How To Create Dataset For Training
    • 3-3 Workflow Guide
      • Image Conversion
      • Inpainting
    • 3-4 Canvas Guide
    • Composite Poster
  • ✨4-Parameters
    • 4-1 Model
    • 4-2 Mode
    • 4-3 Basic Settings
    • 4-4 Advanced Config
    • 4-5 Advanced Repair
    • 4-6 Complete Prompting Guide
    • 4-7 Prompt Edit | Keyword Blending Guide
  • ✨5-Practical Examples
    • AI Influencer
    • LOGO Design
    • E-commerce Poster
    • How To Make Multiple Characters
    • Prompt Templates
    • How to Maintain Character Consistency
    • Useful Prompts
  • ✨6-Permanent Events
    • SeaArt.AI Creator Incentive Program
      • Creator Incentive Program FAQ
    • High-Quality Models Recommendation
      • SeaArt Infinity
      • Stable Diffusion 3.5
      • SeaArt Realism
      • NOOBAI XL
      • T-Ponynai3 V6
      • Counterfeit V3.0
      • Temporal Paradox Mix
    • High-Quality AI Apps Recommendation
    • High-Quality Character Recommendation
    • High-Quality Workflow Recommendation
  • ✨7-FAQ
Powered by GitBook
On this page
  • Prompt Framework
  • Prompt Analysis
  • Application examples
  1. 2-SeaArt AI Basic Function
  2. 2-8 AI Video Generation

Img2Vid

In this guide, we will learn how to write effective prompts, covering how to describe the main subject, control camera dynamics, and even add more special effects to your video.

PreviousTxt2VidNextCamera Movement

Last updated 3 months ago

By simply uploading an image, you can convert it into a video. During this process, accurate and detailed prompts are crucial. If no prompts are provided, the AI will randomly generate video content based on the image. However, with prompts, the AI will create a video based on the combination of the image and the prompts.

Since the image already provides the basic subject and atmosphere, compared to text-to-video, image-to-video can reduce the number of prompts accordingly.

Prompt Framework

Subject + Action + Camera + Light and Atmosphere

  • Subject: Objects appearing in the image, such as people, objects, environmental information, etc.

  • Action: Description of the movement of the objects, such as a person running, environmental changes, spatial transformations, etc.

  • Camera: Camera descriptions are not necessary; after describing the subject and action, SeaArt will generally generate a reasonable dynamic video based on the prompts. If you want to control the camera, you can add descriptions of the camera in the prompts, such as: camera zoom out, etc.

  • Light and Atmosphere: Although the image already has basic lighting and atmosphere, SeaArt can still adjust the overall atmosphere of the video based on the prompts.

Tips:

  1. Accurately describe the subject, and use smooth and concise sentences.

  2. Ensure the completeness of the prompts, and use Prompt Refinement to expand the prompts.

  3. Use short sentences for descriptions.

Prompt Analysis

Before generating a video from an image, we need to determine what kind of video we want. For example, if we want to make the dog in the image move:

Simple prompt:

A dog running on the grass.

Prompt based on the framework:

A dog is sprinting across the grass, making quick turns and leaping with its tail held high. The camera follows closely from a low angle, adjusting its focus as the dog runs, capturing each leap and running moment. The sunlight casts a warm glow on the dog's fur, while the grass is bathed in a warm light. The blue sky and white clouds gently drift in the light breeze in the background, creating a scene full of energy and the warm atmosphere of a peaceful morning.

Application examples

  1. A man talking to a woman.

  1. An anthropomorphic cat walking down the runway.

  1. Glowing text, smoke, camera moving left.

  1. A woman facing the camera.

  1. A ship sailing on the sea, with a shaky camera.

  1. A woman raising her hand to drink coffee.

✨