github mostlygeek/llama-swap v242

4 hours ago

A bunch of changes today:

  • removed the 25MB filesize limit for audio files. This was pulled over by the agents (claude!!!!) from the backend file limit which was fixed a little while ago. Now, upload big files and make your local machines cry!
  • fixed a bug found by @teru358 in #946 where TTL and model request could cause a deadlock. Opus 5 released just in time. It burned all the credits in my 5hr limit but the fix was pretty nice after a bit of back and forth.
  • introduce fully qualified peer model names. Remove the constraint that local and peer model Ids have to be unique.
  • with FQN for peer models the spillover selector can spill over to a remote model. Fun if you have multiple llama-swap rigs and want to tag team in the other one for more parallelism! Qwen 3.6 27B Q8 at 25 tok/sec on the Framework Desktop is still faster than waiting at 0 tokens per second on the busy 3090s.

Changelog

  • 7aa7f52 internal/server,ui-svelte: add peer model namespaces (#950)
  • 5e9f887 Fix process start race during concurrent stop operations (#949)
  • 12af351 ui-svelte: remove audio file size limit (#948)

Don't miss a new llama-swap release

NewReleases is sending notifications on new releases.