Start studying
Module 12 · Generative AI Module contents
Module 12  ·  Card 8 / 18beginner

Image Generation

Modern image generation is dominated by diffusion models.

Latent diffusion runs the process in a compressed space for speed.

A text encoder converts the prompt into a conditioning signal.

Cross-attention injects that signal at every denoising step.

More denoising steps generally means better quality but slower generation.

Learn in depth ↓
Module 12 · Generative AI · 18 concepts
In depth  /  15 lines

Image Generation, in more detail

Modern image generation is dominated by diffusion models.

The process starts from random noise and denoises repeatedly into a picture.

Doing that at full resolution is enormously expensive.

Latent diffusion runs it in a compressed space instead, perhaps 64 by 64.

A VAE encodes to that space and decodes once at the end.

That single change is what put image generation on consumer hardware.

The prompt is turned into vectors by a text encoder, usually CLIP-derived.

Cross-attention injects that signal at every denoising step, so the prompt steers throughout.

The denoising network is typically a U-Net, though transformers are now common.

The number of steps trades quality for speed, with twenty to fifty being usual.

Guidance scale controls how strictly the prompt is followed.

Low guidance drifts off-prompt, and high guidance produces rigid over-saturated images.

The seed fixes the starting noise, so the same seed and prompt reproduce the image.

ControlNet and similar tools add structural conditioning such as a pose or an outline.

Fine-tuning methods like LoRA and DreamBooth teach a specific style or subject cheaply.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
What does cross-attention do in a text-to-image model?
Generative AI

18 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close