LLM Providers

Configure OpenAI, Anthropic, Gemini, or Ollama for CLI-side analysis — and how that differs from the operator’s AI

LLM Providers

Dorgu can use large language models to enhance its application analysis. LLM integration provides deeper code understanding, framework-specific recommendations, smarter resource sizing, and security best practices tailored to your stack.

LLM enhancement is optional. Dorgu’s static analysis and manifest generation work without any LLM provider configured. The LLM layer adds refinements on top of the base analysis.

Two separate AI surfaces

Dorgu has two independent places where an LLM can run. They are configured separately, use different keys, and support different providers. This page covers the first.

	CLI-side	Operator-side
What it does	Enhances application analysis for manifest and persona generation	AI diagnosis of incidents, and AI-written ordered remediation plans
Providers	OpenAI, Anthropic, Gemini, Ollama	Anthropic only for the remediation planner. AI diagnosis also accepts Gemini.
Where the key lives	Your machine — an env var or ~/.config/dorgu/config.yaml	A Kubernetes Secret in your cluster, injected as ANTHROPIC_API_KEY
Configured with	dorgu config set llm.provider … or --llm-provider	Helm values llm.provider, llm.existingSecret, aiRemediation.enabled
Runs when	You run dorgu generate	The operator’s health-check reconciler detects an incident
Documented in	This page	AI setup

Configuring a CLI provider does not enable the operator’s AI, and the operator’s key is never used by the CLI. Setting dorgu config set llm.provider anthropic gives you LLM-enhanced manifest generation and nothing else. To get AI diagnosis and AI remediation plans, configure the operator as described in AI setup.

Supported Providers

Provider	Env Variable	Default Model
OpenAI	OPENAI_API_KEY	gpt-4-turbo-preview
Anthropic	ANTHROPIC_API_KEY	claude-3-sonnet-20240229
Gemini	GEMINI_API_KEY or GOOGLE_API_KEY	gemini-2.5-flash
Ollama	OLLAMA_HOST (endpoint URL)	llama2

Override any of these with dorgu config set llm.model <model> or the llm.model key in .dorgu.yaml.

What LLM Enhances

When an LLM provider is configured, Dorgu uses it to improve several areas of analysis:

• Deeper code analysis — understands business logic, not just file structure
• Framework-specific recommendations — tailored settings for Express, Spring Boot, Django, etc.
• Resource sizing — more accurate CPU/memory recommendations based on application patterns
• Security best practices — context-aware security recommendations beyond generic defaults

---

OpenAI

Setup

# Option 1: Environment variable
export OPENAI_API_KEY="sk-proj-..."

# Option 2: Global config
dorgu config set llm.provider openai
dorgu config set llm.api_key "sk-proj-..."

Usage

dorgu generate . --llm-provider openai

Model Override

dorgu config set llm.model gpt-3.5-turbo

---

Anthropic

Setup

# Option 1: Environment variable
export ANTHROPIC_API_KEY="sk-ant-..."

# Option 2: Global config
dorgu config set llm.provider anthropic
dorgu config set llm.api_key "sk-ant-..."

Usage

dorgu generate . --llm-provider anthropic

---

Gemini

Setup

# Option 1: Environment variable (either key works)
export GEMINI_API_KEY="AIza..."
# or
export GOOGLE_API_KEY="AIza..."

# Option 2: Global config
dorgu config set llm.provider gemini
dorgu config set llm.api_key "AIza..."

Usage

dorgu generate . --llm-provider gemini

---

Ollama

Ollama lets you run LLMs locally without an API key. You need a running Ollama instance with at least one model pulled.

Prerequisites

# Install Ollama (see https://ollama.ai)
# Pull a model
ollama pull llama3

Setup

# Option 1: Environment variable for custom endpoint
export OLLAMA_HOST="http://localhost:11434"

# Option 2: Global config
dorgu config set llm.provider ollama
dorgu config set llm.model llama3

Usage

dorgu generate . --llm-provider ollama

Ollama does not require an API key. The OLLAMA_HOST variable is only needed if your Ollama instance runs on a non-default address.

---

API Key Resolution Order

When Dorgu needs an API key, it checks the following sources in order:

1. Environment variable — OPENAI_API_KEY, ANTHROPIC_API_KEY, GEMINI_API_KEY, or GOOGLE_API_KEY
2. Global config — llm.api_key in ~/.config/dorgu/config.yaml
3. Interactive prompt — if running in a terminal and no key is found, Dorgu prompts you to enter one

Setting Provider in .dorgu.yaml

You can also set the LLM provider at the workspace or app level:

# In .dorgu.yaml
llm:
  provider: "openai"
  model: "gpt-4-turbo-preview"

This is useful when different projects require different providers or models.

Next steps

Operator AI setup

The other AI surface: AI diagnosis and AI remediation plans, Anthropic only

Self-healing

What the operator’s AI planner receives and produces