github ggml-org/llama.cpp b9870

2 hours ago
Details

chat: trim messages sent to StepFun parser (fixes long reasoning loops) (#25238)

  • chat: trim messages sent to StepFun parser (fixes long reasoning loops)

  • add regression test; remove duplicate template

  • chat: trim StepFun content parts before rendering

The StepFun trim workaround ran on the already-rendered messages, where
typed content parts have been concatenated into a single string, so the
per-part whitespace could no longer be reached. Move the trim ahead of
rendering and apply it to content_parts text as well as the string
content and reasoning_content. Adds a content-parts regression test.

Co-Authored-By: Piotr Wilkin ilintar@gmail.com
Assisted-By: Claude Fable 5 noreply@anthropic.com


Co-authored-by: tarruda tpadilha84@gmail.com

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.