This release adds cmd/wol-proxy
, a Wake-on-LAN proxy for llama-swap. If llama-swap lives on a high idle wattage server that suspends after an idle period, wol-proxy will automatically wake that server up and then reverse proxy the requests.
A niche use case but hopefully it will save a lot of wasted energy from idle GPUs.