github mostlygeek/llama-swap v249

7 hours ago

If you use ComfyUI with llama-swap this release is for you. A new /comfyui endpoint was added to make comfy and llama-swap more compatible. Now an idle comfyUI doesn’t block swapping or background HTTP requests cause comfy to load.

To use it create a model named comfyui_auto and llama-swap will take care of the rest. See issue #1001 for a comfyui and docker example to get started quickly.

Changelog

  • f94c94a various: improvements to code layout and naming (#1003)
  • 249797f internal/server: add ComfyUI compatibility endpoint (#1002)

Don't miss a new llama-swap release

NewReleases is sending notifications on new releases.