ComfyUI + Ideogram 4 workflow

Automate Ideogram 4 in ComfyUI: Local LLM Prompt Builder, Bounding Boxes, and LoRA Guide

This guide turns Aiconomist’s 9:59 tutorial into a practical build sheet. The core idea is to stop hand-writing every Ideogram prompt field: use a local Ollama/Gemma-style LLM to inspect a reference image, generate the structured Ideogram JSON prompt, then use bounding boxes and optional LoRAs to control composition, product details, realism, and character consistency.

Source video: 9:59Uploaded: 2026-06-17Guide updated: 2026-06-17Audience: intermediate ComfyUI users
1

What you are building

The video’s upgraded workflow combines four pieces:

Prompt automation

Local LLM → Ideogram fields

An Ollama/Gemma-style local LLM reads a reference image and user override prompt, then fills the Ideogram 4 prompt-builder fields automatically.

Composition control

Bounding boxes

You draw boxes over the target character, background, phone, jersey, logo, or other details so Ideogram knows where each element belongs.

Model options

FP8 or GGUF

The presenter uses FP8 models, but notes that a GGUF quantized version exists for lower-VRAM setups.

Finish

Realism and identity LoRAs

Use aesthetic LoRAs such as the “Lenovo/Lora Nova” analog-realism look, or a custom character LoRA trained on authorized images, to improve consistency.

Best use cases: AI influencer-style photos, consistent characters, outfit variations, product/photo compositions, social-media carousel images, and any Ideogram 4 workflow where manually maintaining multiple prompt fields is slowing you down.
2

Safety, consent, and public-use boundaries

Important: This guide preserves the technical workflow but does not endorse impersonation, harassment, non-consensual likeness use, or deceptive posting. If you use face/character LoRAs, train and generate only with images you own or have explicit permission to use.
  • Do not create private-person likenesses without consent.
  • Do not create student, minor, workplace, medical, or sensitive identity content.
  • Label AI-generated influencer or promotional media when context requires it.
  • Check the license and allowed-use terms for every model, LoRA, workflow, and custom node.
  • Use trademarked logos, team crests, and product marks only in contexts where you have the right to use them.
3

Prerequisites

Required

  • ComfyUI installed and working.
  • ComfyUI Manager or another custom-node installation method.
  • Ideogram 4 workflow/model files available in ComfyUI. The source workflow is linked through the creator’s Ko-fi page.
  • KJ/Ideogram prompt-builder custom nodes updated to a current version with background-image support for the bounding-box draw node.
  • Ollama running locally if you use the local LLM prompt-generation portion.
  • A local LLM model compatible with the prompt-generator node used by your workflow. The video references a Gemma 4 uncensored variant from the creator’s prior workflow.

Hardware expectations

  • The presenter demonstrates on an RTX 5090 and generates quickly at 3:4, 2 MP.
  • Use the GGUF/quantized path, smaller resolution, or 1 MP test generations if VRAM is limited.
  • Unload/keep-alive-manage the LLM if it competes with the image model for VRAM.
Assumption: The video focuses on a downloadable workflow rather than listing every node/model file in the transcript. Treat the published workflow as the source of truth for exact file names and node wiring, then use this guide as the operating manual.
4

Workflow architecture

  1. Reference image input: load an inspiration image. The presenter emphasizes using it as inspiration, not a direct copy.
  2. User override prompt: describe what should change, such as age, ethnicity, hair color, clothing, scene, expression, or background.
  3. Ollama/local LLM node: combines the system prompt, reference image, and user prompt to produce a full positive prompt.
  4. Field splitter / prompt builder: splits the generated prompt into Ideogram prompt-builder fields and formats it into JSON.
  5. Bounding-box draw node: attaches precise object locations and short box descriptions.
  6. Ideogram 4 generation: receives the JSON prompt, model settings, optional LoRAs, size/aspect ratio, and seed.

In the transcript, the automated prompt fields are filled by the Gemma/Ollama node, while the presenter leaves the photo style field manual so it can be quickly changed between candid smartphone photo, cinematic shot, DSLR photo, and other looks.

5

Setup steps

0:53–1:11 1. Choose FP8 or GGUF model path

If you have enough VRAM, use the FP8 workflow/model path shown by the presenter. If not, use the GGUF quantized version of the workflow, then confirm the nodes point to the GGUF loader/model files instead of FP8 files.

1:14–1:29 2. Update the relevant custom nodes

Open ComfyUI Manager and update the Ideogram/KJ prompt-builder nodes. The video specifically notes that the prompt builder gained official support for a background image input, which appears at the bottom of the bounding-box draw interface.

1:43–2:04 3. Configure the local LLM prompt generator

  1. Make sure Ollama is running.
  2. Install or pull the local model used by your workflow.
  3. Load the workflow’s system prompt. Its job is to turn the reference image plus your user override into an Ideogram-ready structured prompt.
  4. Run a small text-only or low-resolution test first so you can confirm the prompt-generation node responds before using full image generation.

2:19–2:55 4. Set aspect ratio and resolution

For Instagram-style images and carousels, the presenter uses 3:4 aspect ratio at 2 megapixels. For faster tests or lower VRAM, use 1 megapixel until the prompt/boxes are dialed in.

3:19–3:39 5. Decide which field stays manual

The text fields are generated automatically, but keep the high-level photo style field manual if you want fast creative control. Examples from the video: candid smartphone photo, cinematic shot, DSLR-style photo.

6

How to prompt and draw bounding boxes

Simple operating loop: load reference image → write a user override → draw boxes → generate → inspect details → change seed or edit one box/prompt → generate again.

Use the user prompt for global overrides

The user prompt should tell the LLM what to change from the reference, not merely repeat what is already visible. Example from the video: change the subject into a 40-year-old Italian woman with dark brown hair.

Use boxes for local precision

  • Character box: identify the person, expression, hair, pose, or custom LoRA trigger word.
  • Background box: specify car interior, bedroom mirror, locker-room wall, street scene, etc.
  • Object box: phone type, product placement, accessory, logo, jersey, nails, or other small details.
  • Logo/detail box: add precise crest/star/brand information when a detail is easy for the model to invent incorrectly.

Keep box text short but decisive

Boxes work best as brief, localized instructions: “black iPhone 16 in hand,” “Spanish national football jersey, one star above crest,” “red nail polish,” or “backseat car interior.” Avoid long paragraphs inside a box; reserve broader style and identity instructions for the main user prompt.

7

LoRAs: realism, identity, and when to enable them

Analog realism

Lenovo / Lora Nova style LoRA

The presenter enables an analog-realism LoRA after a baseline image. The result is softer skin texture, more natural lighting, and less plastic-looking AI skin. Use this when the base output is too synthetic.

Character consistency

Custom face/character LoRA

A custom Ideogram 4 character LoRA can preserve identity across poses and outfits. Put the LoRA trigger word directly inside the character box for stronger adherence.

Consent rule: custom identity LoRAs should only use your own images or images from someone who explicitly allowed that training and generation use.
8

Examples from the video, translated into repeatable recipes

2:19–5:08 Recipe A: Reference-to-new-character car photo

  1. Load a reference image for pose/composition inspiration.
  2. User prompt: change the subject identity, age, hair, and other global attributes.
  3. Set 3:4 at 2 MP, or 1 MP while testing.
  4. Draw a character box where the person should sit.
  5. Draw a background box labeled car interior/backseat.
  6. Generate, then inspect clothing, accessories, face, and background accuracy.

5:40–6:47 Recipe B: Football jersey mirror selfie

  1. Tell the user prompt that the composition is a mirror selfie.
  2. Draw a phone box and name the phone, such as “black iPhone 16.”
  3. Add a small local detail such as red nail color if important.
  4. Draw a box around the jersey and specify team, crest, and any star count.
  5. If the output is nearly right but details are off, change the seed before rewriting the whole prompt.

6:52–8:27 Recipe C: Custom character LoRA plus team outfit

  1. Enable the custom character LoRA.
  2. In the user prompt, say that the identity should change to your authorized character.
  3. Put the character LoRA trigger word in the character box.
  4. If expression is wrong, add a short expression cue such as “smiling” in the character box.
  5. Layer the realism LoRA if the skin/lighting feels artificial.

8:36–9:18 Recipe D: Fix brand/logo detail and background

  1. For small logos, draw separate boxes over each detail area.
  2. Use one box for federation/crest/star details and another for a brand logo if needed.
  3. If the LLM invents an inaccurate background description, override the background in the user prompt and regenerate.
9

Verification checklist

  • The Ollama/local LLM node returns a usable prompt before image generation starts.
  • The prompt-builder fields fill automatically instead of requiring copy/paste.
  • The bounding-box UI shows the reference/background image input after updating nodes.
  • Aspect ratio and resolution match the target platform: 3:4 and 2 MP for high-quality Instagram-style outputs; 1 MP for fast tests.
  • All required model files load without missing-node or missing-model errors.
  • Generated image respects the main identity override, background, and at least the highest-priority boxes.
  • Small details such as logos, phones, star counts, and nail color are checked manually before sharing.
10

Troubleshooting

ProblemLikely causeFix
Prompt fields are not filling automaticallyOllama model not running, model name mismatch, or splitter node not connectedRun a small LLM-only test, confirm the selected Ollama model is installed, then check the connection from LLM output to field splitter/prompt builder.
Bounding-box node does not show the reference/background imageOutdated KJ/Ideogram prompt-builder nodesUpdate custom nodes in ComfyUI Manager and restart ComfyUI.
Out of VRAMImage model, LLM, LoRAs, and high resolution are competing for memoryUse GGUF/quantized model path, lower to 1 MP, unload the LLM after prompt generation, disable LoRAs while testing, or generate at lower batch size.
Pose or composition is close but not idealSeed variation neededChange the seed and regenerate before rewriting all prompts.
Logo/team detail is wrongSmall details are underspecified or not boxedAdd a dedicated box over the detail, describe star count/crest/brand precisely, and inspect before posting.
Face looks right but expression is wrongCharacter LoRA is active but expression cue is weakAdd “smiling,” “neutral expression,” or the intended expression directly in the character box.
Skin looks plasticBase model/style is too syntheticEnable the analog-realism LoRA after the composition works; do not use it as the first debugging variable.
11

Sources and preserved links

  • Primary video: Automate Ideogram 4 in ComfyUI (Let AI Write Your Prompts!) by Aiconomist, uploaded 2026-06-17.
  • Workflow download link from the video description: Ko-fi workflow download.
  • Transcript-derived timestamps used in this guide: prompt generator at 1:26–2:18, aspect ratio/resolution at 2:36–2:55, KJ prompt builder update at 3:00–3:18, bounding boxes at 3:40–4:18, generation chain at 4:32–4:53, LoRA examples at 5:11–8:27.

This guide is based on the provided video transcript and description links. Exact node/model filenames may change; verify against the downloaded workflow and current model/custom-node pages before installing.