Ollama
A local LLM server. Lens writes and refines captions through it. Darkroom can expand prompts with it. The SingGuard guard server runs its model on it.
Used by
Official guides
- Download Ollama (opens in new tab)
- Ollama on Linux (opens in new tab)
- Ollama in Docker (opens in new tab)
- OpenAI compatibility (opens in new tab)
- Run a Hugging Face GGUF in Ollama (opens in new tab)
Minimal setup
-
Install Ollama (native or Docker) and pull the models you'll use. For example, lens's refine default and a vision model for captions:
ollama pull qwen3:8b ollama pull qwen3-vl:8b -
Ollama listens on
127.0.0.1:11434by default. For containers or other machines to reach it, setOLLAMA_HOST=0.0.0.0on the Ollama side, and only on a trusted network: Ollama has no authentication. -
Point the clients at it:
- lens uses the OpenAI-compatible path, with
/v1:ARGUS_OPENAI_COMPAT_BASE_URL=http://<GPU_HOST>:11434/v1andARGUS_OPENAI_COMPAT_MODEL=qwen3-vl:8b. From inside a container on the same machine, usehttp://host.docker.internal:11434/v1. - darkroom uses Ollama's native API, with no
/v1:ARGUS_DARKROOM_OLLAMA_URL=http://<GPU_HOST>:11434and a model inARGUS_DARKROOM_OLLAMA_MODEL. Both must be set for--expandto work.
- lens uses the OpenAI-compatible path, with
Studio's lens profile runs its own Ollama, and a one-shot ollama-pull
fetches the refine model, so you need neither step for that profile.