MMOOZZGG.com

Glossary

What is Stable Diffusion?

In short

Stable Diffusion is a family of open models that create images from text. You can download them and run them on your own computer or server.

Models and products · Stable Diffusion

MMOOZZGG.com editorsChecked: 1 min read

For a child

Imagine a foggy window where you wipe away spot after spot with your finger until a picture shows through. This program draws in a similar way: it starts with colored noise, like static on an old TV, and step by step removes what is not needed until it gets the cat, castle or rocket you described in words.

In plain words

You write a description, such as “a lighthouse on a rock during a storm”, and the model creates the picture. Inside, it starts from random noise and, in a few dozen steps, turns it into an image that fits the text. The main difference from many services is that the model weights are open. You can download them, run them on your own graphics card, train them further on your own pictures and add styles. This is why many free programs and add-ons grew up around the model.

For business

Companies use Stable Diffusion for illustrations, product cards, layouts and backgrounds when images must not go to an outside cloud. The model runs on your server, the data stays in the company, and the costs are the graphics card, electricity and an engineer’s time. The license depends on the version: early models came under CreativeML OpenRAIL-M, and current ones under the Stability AI Community License, free for organizations with annual revenue under USD 1 million; larger ones need an Enterprise License. The license has no list of banned countries, but it requires compliance with export control and sanctions laws, so a lawyer reads the text. The server configuration for such a task is worked out before you buy hardware.

For a specialist

It is based on latent diffusion (Latent Diffusion Models): Rombach et al. (2021) proposed running the diffusion process not in pixels but in the latent space of a pretrained autoencoder, and added cross-attention layers to condition generation on text or a layout. The card of version 1.4 calls it a latent text-to-image diffusion model, developed by Robin Rombach and Patrick Esser and trained on LAION-2B (en). Stable Diffusion 3.5 Large moved to a multimodal diffusion transformer (MMDiT) with 8 billion parameters, QK normalization and three frozen text encoders: OpenCLIP-ViT/G, CLIP-ViT/L and T5-xxl. LoRA adapts the model to a style, and negative prompts keep unwanted things out of the frame.

Example

A furniture factory runs the model on its own server and creates backgrounds for sofa photos: a living room, a loft, a country house. The product photos never leave the company, and a designer picks the good variants.

Related terms

Questions and answers

Can a business use Stable Diffusion for free? Current models come under the Stability AI Community License: it is free while the organization’s annual revenue stays under USD 1 million. Larger companies need an Enterprise License from Stability AI.
What do you need to run Stable Diffusion yourself? A computer or server with a graphics card that fits the chosen model version, and a program to run it. The larger the model, the more video memory it needs.

Sources

Not sure whether your company needs this?

AI solutions map
Contact us