github mostlygeek/llama-swap v220

3 hours ago

Another release? Who needs to touch grass?

This release includes a small patch by first time contributor @Luiszzzor. As well a new load and concurrency testing tool has been added to the Playground. It's easier to show than tell so check out this demo video with a swap matrix example:

llama-swap-concurrency.mp4

Side note: I forgot to mention in the video that to support more than 5 or 6 (depending on your browser) concurrent requests you will need a valid TLS certificate. llama-swap supports http/2 however that requires https. In the demo I run it on my tailnet with tailscale serve 8080 which generates the Let's Encrypt cert for me.

Changelog

  • 03d58e5 Add load testing tool to the UI (#805)
  • c790d0e fix: update the concurrency middleware to respond with a JSON payload (#798)

Don't miss a new llama-swap release

NewReleases is sending notifications on new releases.