github ggml-org/llama.cpp b8287

2 hours ago
Details

common/parser: handle reasoning budget (#20297)

  • v1

  • Finished!

  • Handlie cli

  • Reasoning sampler

  • Apply suggestions from code review

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

  • Less explosive terminology :)

  • Add utf-8 case and tests

  • common : migrate reasoning budget sampler to common

  • cont : clean up

  • cont : expose state and allow passing as initial state

  • cont : remove unused imports

  • cont : update state machine doc string


Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com
Co-authored-by: Alde Rojas hello@alde.dev

macOS/iOS:

Linux:

Windows:

openEuler:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.