4.2 · Local Stable Diffusion (ComfyUI, A1111)

Level 4 · Expert: pro workflows

4.2Local Stable Diffusion (ComfyUI, A1111)

Goal: Have a free, private, unlimited local studio ready for the advanced extensions in the next section.
Estimated time: 13 min · self-paced reading · If you only have 5 min: read “The essentials in 30s” + the diagram.

The essentials in 30 seconds

  • Local changes the nature of the exercise: free and unlimited, private (nothing leaves the machine), total control (models, settings, ControlNet, LoRA) and longevity.
  • Two interfaces: Automatic1111 (tabs and forms, for getting started) and ComfyUI (linked nodes, demanding but reproducible — the studios' tool).
  • Sonia's reflex: check the VRAM first, test online before investing — and only download from reputable sources, with the license verified.

Running case — Sonia and the confidential catalog

Sonia, freelance graphic designer in Algiers, lands a job for a local brand: twenty catalog visuals whose products must not leak anywhere before launch — impossible to send working photos to an online service. She sets up a Stable Diffusion studio on her machine: she checks her graphics card and VRAM, installs Automatic1111 to learn the fundamentals (steps, CFG, sampler), and downloads a base model from a reputable source after checking its commercial-use license. When her sequences become repetitive, she switches to ComfyUI for saveable, reproducible workflows. Second milestone of the running case: from consuming a service, Sonia becomes the owner of her tool — nothing leaves her studio.

Sequel to case 4.1 — Sonia moves from local retouching to a local studio.

1. Four decisive advantages

Stable Diffusion installed on your own machine changes the nature of the exercise: you move from a service you consume to a tool you control. Free and unlimited: no subscription, no quota, you generate as much as your hardware allows. Privacy: nothing leaves your computer — as with Sonia's catalog, this is often the decisive argument in business or for projects under NDA.

Total control: choice of model among thousands of specialized community models, access to every setting, and above all the advanced extensions — ControlNet, IP-Adapter and LoRAs (section 4.3) — which have no equivalent in closed services. Longevity: the model is yours, it will not change overnight.

2. Two interfaces: A1111 for starting, ComfyUI for industrializing

Automatic1111 (often shortened to A1111): the most classic, organized in tabs and forms — the simplest for getting started, very well documented. ComfyUI: a node interface where you visually connect the steps (model → prompt → sampling → output); learning is steeper, but it offers incomparable control and reproducibility, with reusable, shareable workflows — the tool of advanced users and studios.

The recommended path, like Sonia's: start with A1111 to master the fundamentals (the effect of steps, CFG, samplers, models), then switch to ComfyUI when you feel limited — typically to chain several treatments automatically or reproduce a process exactly. The concepts are identical: what you learn on one transfers to the other.

3. Hardware prerequisites and entry method

The main prerequisite is hardware: a dedicated graphics card with enough video memory (VRAM) is strongly recommended; NVIDIA cards are best supported. With little VRAM, generation becomes slow or impossible on recent models — and advanced extensions (ControlNet, LoRA training) are hungry.

Two entry tips. First, allow real learning time: installation, model choice, settings — this is an investment, not an instant solution. Second, only download models from reputable sources, and check their license: some community models forbid commercial use. And before investing in hardware: test online first — many discover that Midjourney covers most of their needs for less than a graphics card.

Common misinterpretation: “Local is just free Midjourney: I install it and generate the same way.” No. Local is a different craft: installation, version compatibility, model choice, settings (steps, CFG, sampler), VRAM to watch — in exchange for privacy, unlimited volume and advanced extensions. It is not a saving, it is an investment in control.
Setting up your local studio Control, don't consume Check the hardware Graphicscard, VRAM (NVIDIA)Choose the interface A1111 tostart, ComfyUI nextInstall and tune Base model,steps, CFG, samplerExtend ControlNet, LoRA(section 4.3)
Control, don't consume
Text version of the diagram (SEO / screen readers / translation): 1) Sonia checks her graphics card and VRAM (the limiting factor) and first tests online to validate her need. 2) She installs Automatic1111, the most accessible option, and masters the fundamentals one setting at a time. 3) She downloads a base model from a reputable source, commercial-use license verified. 4) When her sequences repeat, she switches to ComfyUI for reproducible workflows, the gateway to extensions (section 4.3). Lesson: hardware, simple then powerful interface, reliable sources — never install without checking.

🔎 Concrete example — 🔎 Concrete example — Sonia's studio, step by step

Sonia sets up her local studio for the confidential catalog. Her path, with the real actions:

1. Check the hardware: dedicated graphics card + available VRAM (otherwise: online service or hourly cloud GPU).
2. Install Automatic1111 following the official documentation.
3. Download ONE base model from a reputable source (commercial license verified).
4. Explore steps, CFG, sampler: change only one setting at a time.

Reading: hardware first, simple interface, one model, one setting at a time.

Lesson: nothing leaves the machine — the catalog's confidentiality is guaranteed by design.

Section vocabulary

Local Stable Diffusion
Running the model on your machine: free, unlimited, private and fully configurable.

Simple example: Sonia generates the catalog's twenty visuals without any working photo leaving her studio.

What it is not: an online service where every image passes through third-party servers.

Reflex: confidential project or large volume: consider local.

Automatic1111 (A1111)
Classic web interface with tabs and forms; the most accessible way to start locally.

Simple example: Sonia learns the effect of steps, CFG and samplers there in one evening.

What it is not: a graph of nodes to wire yourself.

Reflex: starting locally: A1111 first, ComfyUI when limited.

ComfyUI
Node interface visually linking the steps; more demanding but highly reproducible and powerful.

Simple example: Sonia chains generation, upscaling and retouching there in a saved, replayable workflow.

What it is not: a single Generate button for one image.

Reflex: repeating process: freeze it as a ComfyUI workflow.

VRAM
Graphics card memory; the main limiting factor for local generation.

Simple example: With comfortable VRAM, Sonia generates fast and uses extensions; with little VRAM she would be stuck.

What it is not: system RAM or connection speed, secondary here.

Reflex: before any local project: check available VRAM.

In practice — In practice — Getting started locally

  1. Check your hardware: dedicated graphics card and available VRAM (main limiting factor).
  2. Choose an interface: Automatic1111 to start simply, ComfyUI if you want control and reusable workflows.
  3. Install it following the official documentation, then download a base model from a reputable source (license verified).
  4. Generate a first image, then explore the key settings (steps, CFG, sampler) by changing one setting at a time.
You have a free, private, unlimited local studio, ready for the next section's advanced extensions.

Ready-to-say script — justifying local to a client (30 s)

“This is Sonia: for your confidential catalog, I work locally — nothing leaves my studio, no photo on a third-party server, and I can generate without limit until approval. It takes a bit more setup time, but your visuals stay strictly between us.”

Say this when scoping a confidential job; also state the license of the models used.

Copy-paste template — local project scoping sheet

Project: [20-visual catalog — confidential]
Hardware: [model] card, VRAM [amount] → OK / to upgrade
Interface: A1111 (discovery) → ComfyUI (production)
Base model: [name] — source [reputable] — commercial license: [verified yes/no]
Starting settings: steps [value], CFG [value], sampler [name]

Freelancer and confidential projects

Like Sonia: local guarantees by design that nothing leaks — a decisive selling point.

Large volume of variants

With no quota, iterate endlessly: series, variants and unlimited trials for the price of the hardware.

Small hardware, no GPU budget

Online services offering Stable Diffusion, hourly cloud GPU rental, or staying with server-side Midjourney.

Toward advanced extensions

ControlNet, IP-Adapter, in-house LoRA (section 4.3): local is their natural home — gradual ramp-up.

Caution: Local involves your hardware and your liability: only download models from reputable sources (a model file can be booby-trapped) and always check the license — some community models forbid commercial use. On a client project, document the model and its license as you document your fonts.

✓ Best practices

  • Test online before investing in a graphics card: real need must come before purchase.
  • Start with A1111, move to ComfyUI when your sequences become repetitive.
  • Check the origin AND the license of every downloaded model, especially for commercial use.

✗ Common pitfalls

  • Underestimating VRAM needs: generation becomes slow or impossible on recent models.
  • Expecting an instant solution: installation, models and settings require real learning.
  • Downloading a model without checking its commercial-use license.

Key takeaways

  • LOCAL = free, unlimited, private (nothing leaves the machine) and fully controllable.
  • A1111: simpler for starting. ComfyUI: nodes, more demanding but reproducible and powerful.
  • HARDWARE prerequisite: dedicated graphics card with enough VRAM (NVIDIA best supported).
  • Reliable SOURCES + verified LICENSE; test online before investing.

48h challenge — apply tomorrow

Check your VRAM, try 1 online Stable Diffusion generation (no install), and list 1 real case (privacy, volume, control) that would justify going local for you.

Section exit checklist
  • I can explain the 4 advantages of local (free, unlimited, private, controllable).
  • I can choose between A1111 (starting) and ComfyUI (reproducible workflows).
  • I check hardware, source and license before any local project.
Self-rating 1-5: do I know what VRAM I have and what it allows?have I ever checked a model's license before commercial use?

Frequently asked questions

What setup do you really need to run Stable Diffusion?

The deciding factor is the graphics card, especially its VRAM — far more than processor or RAM. With little VRAM: older models, small resolutions, long times, even blocked on recent models. With comfortable VRAM: smooth generation and hungry extensions (ControlNet, LoRA training). NVIDIA cards are best supported; AMD and Apple Silicon work with more friction. Alternatives: online services, hourly rented cloud GPU, or server-side proprietary tools. Tip: test online first — local is justified by a real need for privacy, volume or advanced features.

A1111 or ComfyUI: which to choose first?

Start with A1111: familiar interface (tabs, sliders, Generate button), huge documentation, productive in an hour — ideal for learning the fundamentals. Switch to ComfyUI when limited: transparent node graph, saveable and shareable custom workflows, perfect reproducibility, often faster — the pro-pipeline tool. The concepts are identical in both: never wasted time.

Check your understanding

What is the main limiting factor for local generation?

Additional resources (optional, to go further)

Level 4 examFresh, harder questions to test what you've learned