github ggml-org/llama.cpp b7329

latest releases: b7376, b7366, b7375...
4 days ago

Warning

Release Format Update: Linux releases will soon use .tar.gz archives instead of .zip. Please make the necessary changes to your deployment scripts.

llama : add token matching support to llama-grammar (#17816)

  • llama : add token support to llama-grammar

  • fix inverse token comment

  • refactor trigger_patterns to replay tokens instead of the entire string

  • add token documentation

  • fix test-llama-grammar

  • improve test cases for tokens

macOS/iOS:

Linux:

Windows:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.