github ggml-org/llama.cpp b12362

pre-release56 minutes ago
Details

grammar : optimize matching with left factoring (#29557)

  • grammar : limit the number of alternatives

  • grammar : introduce an AST for grammar parsing

  • grammar : revert AST refactor and alternatives limit

This reverts commits:

  • grammar: optimize big grammar matching by using left-factorization

  • grammar : preserve character class boundaries during left factoring

  • grammar : prevent infinite expansion during left factoring

  • grammar : use ASCII characters in comments

  • grammar : test empty suffixes after left factoring

  • grammar : deduplicate left factoring logic

  • grammar : add comments

  • grammar : use number parameters and clarify RSS output

  • grammar : clarify character class test names

  • grammar : remove performance benchmark

  • grammar : share immutable rules


Co-authored-by: Piotr Wilkin piotr.wilkin@syndatis.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.