Skip to content

.tip

· one of the small things

Commit messages do not need the frontier model

Small input, small constrained output, and a wrong answer that costs little: for tasks like that, a 30B open-weight model on a laptop can't be told apart from a hosted one. Point the tool at a local server that speaks the same API.

LLM_BASE_URL=http://127.0.0.1:11434/v1
LLM_MODEL=qwen3-30b-a3b

The bill isn't really the reason. The reason is that the diff never leaves your machine.

llmlocal-models

Longer version: the post this came from.