github ggml-org/llama.cpp b9077
on GitHub

2 hours ago
Details

server: support Vertex AI compatible API (#22545)

  • server: support Vertex AI compatible API

  • a bit safer

  • support other AIP_* env var

  • various fixes

  • if AIP_MODE is unset, do nothing

  • fix test case

  • fix windows build

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

Check out latest releases or
releases around ggml-org/llama.cpp b9077

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.

Get notifications