github mostlygeek/llama-swap v262

2 hours ago

systemone models are mega hyped right now. This release adds support for
/v1/systemone for that fast thinking goodness(?). Also requests missing a
Content-Type will get one automatically added for the inference endpoints.

  • PR #1197 Add /v1/systemone endpoint to POST JSON routes: route llama.cpp's new /v1/systemone decision model endpoint to the model named in the JSON body (#1195) by @mostlygeek
  • PR #1194 internal/server: accept JSON bodies with a missing or wrong Content-Type: fix a misleading "no model id could be identified" 404 when curl -d sent JSON as form-urlencoded; a middleware now relabels JSON object bodies as application/json and returns a 400 naming the expected format for unusable bodies (#1192) by @mostlygeek

Don't miss a new llama-swap release

NewReleases is sending notifications on new releases.