This release includes security dependency updates and requested quality of life changes from users:
- the UI no longer expects to be run under a root path making it easier to serve llama-swap behind another proxy
- the max request size is configurable now. Users should be free to OOM as much as they want. llama-swap ain't your mom!
- allow manual override of values in /v1/audio/voices. This is a non-standard endpoint but makes working with upstream audio engines a bit nicer
Details below:
- PR #1224 cmd/kubeswap: attach DRA ResourceClaims and mount NFS volumes: add repeatable
--resource-claimand NFS--volumesupport so Kubernetes backends can share a DRA GPU claim and mount models without a static PV and PVC for each export (#1222) by @gabrielcosi - PR #1225 Add voices override for speech models: let local models configure
capabilities.voicesso/v1/audio/voicesreturns a reliable list without starting the model or querying the upstream server (#1207) by @mostlygeek - PR #1228 ui,server: serve the UI under a reverse proxy base path: use relative asset, API and redirect paths so the UI works behind a prefix-stripping reverse proxy without routing its endpoints at the proxy root (#1227) by @mostlygeek
- PR #1249 internal/server: make the request body size limit configurable: add
maxRequestBodyMBfor model endpoints and Tailcat, replacing the fixed 250 MB cap while retaining 250 MB as the default (#1245) by @mostlygeek - PR #1257 AGENTS.md, go.mod: use go 1.27.3, trim AGENT rules: raise the Go version to 1.27.3, update dependencies and simplify contributor instructions by @mostlygeek