github mostlygeek/llama-swap v259

5 hours ago

Maintainer note:

This release includes a bunch of small UI improvements and
requests from users. It also includes a contribution to detect DGX Spark
hardware more accurately.

I'm working on the AI sloppiness of the change log generation. The details
are correct but I need to tune it. Perhaps I'll just keep writing notes at the
top like this :)


Logging is split into three separate streams: proxy, upstream and HTTP access
logs. HTTP request lines used to be mixed in with the proxy log, which made it
hard to search. They now have their own stream and their own tab in the log
viewer. The logToStdout setting accepts a comma separated list of streams, such
as "proxy,http", and the old values still work.

Upgrading: log data has moved off GET /api/events to a new GET /api/events/logs
endpoint. Pick streams with ?stream=proxy&stream=http. Tools that read logs
from /api/events need to switch to the new endpoint.

The UI sidebar can be resized by dragging its edge, and the width is
remembered. The model page has a new header that shows the model name, a
copyable ID, its state and how long it has been ready. The API also returns a
new readySince field for models that are ready.

The Hardware page now recognizes DGX Spark (GB10) systems. Before this, it
could not count sockets on arm64, labeled the unified memory as dedicated
memory it could not detect, showed only the efficiency cores and had no power
figure. It now shows the system model, the hybrid CPU layout, shared memory
and the nominal 140 W SoC power.

The "install as app" prompt now works when apiKeys is set. The browser fetches
the web app manifest without an API key, so it got a 401. The manifest is now
served without auth, like the favicon.

The release process now checks for Claude or Codex before generating the
changelog and uses a newer model for it.

  • PR #1177 internal/server: serve web app manifest without requiring auth: let browsers fetch site.webmanifest when apiKeys is set so the install prompt appears
  • AGENTS.md: revise contribution guidelines for PRs: agents check pull requests and issues against CONTRIBUTING.md and ask when there is a problem
  • PR #1172 Refactor logging to support multiple streams and separate log endpoints: split proxy, upstream and HTTP logs, add /api/events/logs and allow a stream list in logToStdout
  • PR #1163 hw: detect DGX Spark (GB10) systems: report the system model, hybrid CPU, sockets, shared memory and nominal power on GB10 boxes by @lemassykoi
  • PR #1173 ui: sidebar resize, model uptime tracking, small tweaks: drag to resize the sidebar and show how long each model has been ready
  • scripts/add-changelog.sh: use gpt-6-sol: update the model used to generate changelog entries with Codex
  • Makefile: detect harness before release: use Claude or Codex to generate the changelog and stop with an error when neither is installed

Don't miss a new llama-swap release

NewReleases is sending notifications on new releases.