github skye-harris/hass_local_openai_llm 1.8.0

8 hours ago

Llama.cpp configuration

New Conversation and AI Task entity names will be prefixed with their server name for easy identification
Added sampling parameters under llama.cpp configuration options on Conversation and AI Task entities
Added a separate option to include prior model thinking content in the message history, disabled by default:

  • Some models require this to be passed back, while some models explicitly request this not be provided

What's Changed

Full Changelog: 1.7.0...1.8.0

Don't miss a new hass_local_openai_llm release

NewReleases is sending notifications on new releases.