github ggml-org/llama.cpp b10172

latest release: b10173
2 hours ago
Details

ggml-webgpu: Fix some binding alias issues to support all archs, fix recurrent-state-rollback test (#25931)

  • Add overlap glu variant to support all archs, fix recurrent-state-rollback test

  • format

  • Fix all arch overlapped ranges

  • format

  • diagnose bus error on apple ci

  • More testing

  • more testing

  • more targeted testing

  • Fix bug in alignment for > 4gb buffer offsets

  • Fix bug in view offsets

  • Try avoiding multi_buffers

  • not fixed yet, more logging :(

  • Handle edge case in set_rows

  • Try looking at view source

  • Skip deepseek32 for now and clean up trace infrastructure

  • simplify skipping

  • last cleanup

  • actually final cleanup

  • update handling of overlap

  • format

  • try skipping other failing model

Website:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.