Added
- Per-model thinking configuration and budget. The Conversation feature's model form now has a Thinking / reasoning setting for every chat provider, plus a Thinking budget (tokens) field for providers whose API supports one (OpenAI-compatible servers such as llama.cpp, Gemini, Anthropic). Settings are remembered per model name, so switching the chat model from, say, Gemma (thinking on, budget 512) to Qwen (thinking off) and back restores each model's configuration automatically — the conversation itself is untouched. Each choice maps to what the provider actually understands: Ollama's
reasoningfield (with effort pass-through for gpt-oss),reasoning_effortandchat_template_kwargs.enable_thinkingfor OpenAI-compatible servers,reasoning_effortfor cloud OpenAI,thinking_budgetfor Gemini, and extended thinking withbudget_tokensfor Anthropic (budget clamped andmax_tokens/temperature adjusted as the API requires). Entering a budget with the select at Provider default counts as turning thinking on. Full per-provider details are in the new "Per-Model Thinking / Reasoning" section of the configuration guide. Requested by @krishgcek (#580).
Fixed
- llama.cpp reasoning could not be controlled through HGA. The OpenAI-compatible provider previously sent no reasoning fields at all, so neither
--reasoning onnor system-prompt instructions had any effect while the llama.cpp WebUI worked with the same model and server. HGA now sends the same per-request fields the WebUI uses. Note: a--reasoning-budgetset on the server command line still overrides the per-request budget. Reported by @krishgcek (#580). - A rejected
reasoning_effortno longer fails chat. A model that rejects the parameter (for example a non-reasoning cloud OpenAI model) is automatically retried without it, the same way unsupportedtemperature/top_pvalues already were.