mostlygeek/llama-swap v250

on GitHub

Lots contributors to thank on this release:

• @einhander for greatly improving the cmd/vllm-wrapper and @depohmel for the initial contribution.
• @chaserhkj for adding /v1/task/run endpoints for audio.cpp
• @cphlipot for improving llama-server context compatibility and adding the /models endpoint
• @noctrex for the cool new capabilities labels in the model UI (see screenshot below)

This release also updates the unifed docker container to come with:

• audio.cpp
• llama-bench
• vllm-wrapper

Enjoy!

PS: check https://github.com/mostlygeek/retrocraft - Qwen 3.8 27B demo

Changelog

• 60226b6 docker/unified: add llama-bench, vllm-wrapper, audio.cpp (#1011)
• 44a17d7 README.md: reorder list of features
• 3bccbef Support argv-based vLLM startup in vllm-wrapper (#979)
• be683dc ui-svelte,internal/server: show capability tags on Models page (#1007)
• 2edfa73 api: support /v1/task/run for audio.cpp (#982)
• be50598 AGENTS.md: tweak rules around pull requests
• 3e583ad CONTRIBUTING.md: update rules
• 038ae45 expose meta.n_ctx on models endpoint (#984)
• 6333ee3 router: add /models endpoint (#983)