github mostlygeek/llama-swap v233

4 hours ago

Bug and Performance improvements for the UI

  • fixed streaming logs blocking llama-server inference. Logs are pushed to connected UI clients via an async channel now so if they are slow it does not affect reading from stdout of llama-server
  • replaced the placeholder.txt with a go build tag approach - fix CI

Changelog

  • 083e421 internal/logmon: decouple log broadcast from Write (#878)
  • a667c57 internal/server: gate UI embed behind embed_ui build tag (#880)

Don't miss a new llama-swap release

NewReleases is sending notifications on new releases.