This release includes a new auto:orphans set for swap matrix rules. This new set automatically includes all models that were not explictly added to a set. It is defined as (orphan1 | orphan2 | orphan3 | ...). The orphans set is handy for definitions like: +always & +auto:orphans, where +always is a set of models that are always loaded and should never be swapped out.
The /audiocpp endpoint was added to make working with audio.cpp server eaiser. The audiocpp_auto model is automatically used when the endpoint is requested. audio.cpp's OpenAI compatible endpoints can be accessed directly via /audiocpp/v1/audio/*. Very handy when used with llama-swap's unified docker container which builds audio.cpp with the UI and native model downloader.
Also one tiny commit to improve compatibility with llama-server's decision model functionality.
Thanks to the contributors in this release, especially @knguyen298 for being patient and keeping the PR updated.
- PR #1026 internal/matrix: add synthetic auto:orphans set: adds a
+auto:orphansselector that expands to every model not named in another set, so a catch-all set like"+always & +auto:orphans"picks up new models automatically (#1025) by @knguyen298 - PR #1223 Add /audiocpp endpoint for audio.cpp UI passthrough: serves audio.cpp's web UI and model management through a dedicated
/audiocpp/endpoint bound to the reservedaudiocpp_automodel, like/comfyui/, so the unified container works without naming a model per request by @mostlygeek - PR #1220 internal/capcompat: detect decision models from llama-server's listing: fix decision models being reported as
out: [text](andcapabilities.out: [decisions]failing validation) because discovery only read/props;output_modalitiesfrom/v1/modelsis now used, and tools are only advertised when the model outputs text (#1219) by @nazeshinjite