github ggml-org/llama.cpp b10166

latest release: b10167
2 hours ago
Details

ggml : set output of view src (#25729)

  • llama-graph: set_outputs to t->view_src

  • change set_output to GGML_ASSERT about views not being outputs

  • sampler : avoid views in outputs

  • cont : fix dist sampler

  • cont : consistent logits handling

  • ggml : set output of view src

  • graph : simplify set_outputs()

  • cont : cleanup

Co-authored-by: Gaurav Garg gaugarg@nvidia.com


Co-authored-by: Georgi Gerganov ggerganov@gmail.com
Co-authored-by: Gaurav Garg gaugarg@nvidia.com

Website:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.