mostlygeek/llama-swap v237

on GitHub

Notes

• Support for the new metrics and usage data in vllm responses
• Fix some small UI nits
• Remove the 10sec wait delay in wol-proxy.
  • random: mine's been running for months, all those 10s waits of my life I wasted everytime I updated my config!

Changelog

• 9e63971 ui-svelte: activity logs older than a day show a timestamp (#911)
• 0e5807a internal/server: support vLLM metrics (#910)
• ca723d3 cmd/wol-proxy: remove lag when llama-swap restarts (#909)
• fdda55e Remove Star History section from README