github mostlygeek/llama-swap v167

one day ago

This release adds cmd/wol-proxy, a Wake-on-LAN proxy for llama-swap. If llama-swap lives on a high idle wattage server that suspends after an idle period, wol-proxy will automatically wake that server up and then reverse proxy the requests.

A niche use case but hopefully it will save a lot of wasted energy from idle GPUs.

Changelog

  • c07179d cmd/wol-proxy: add wol-proxy (#352)
  • 7ff5063 Update README for setup instructions clarity [skip ci]
  • 9fc0431 Clean up and Documentation (#347) [skip ci]

Don't miss a new llama-swap release

NewReleases is sending notifications on new releases.