github ggml-org/llama.cpp b11019

latest releases: b11022, b11020
pre-release2 hours ago
Details

gguf : align the data section relative to the GGUF start, not the file (#28993)

  • gguf : align the data section relative to the GGUF start, not the file

gguf_init_from_file_ptr reads a GGUF from the current file position, but padded
the data section from file offset 0, so a GGUF embedded at an offset that is not
a multiple of the alignment loaded without error and returned wrong tensor data.

Also adds llama_adapter_lora_init_from_file_ptr, and disables mmap with a warning
when an embedded data section is not aligned, instead of asserting in ggml.

Assisted-by: Claude Opus 5

  • llama : load lora from path through the FILE* variant

The test now checks that mmap is disabled only for an unaligned offset.

Assisted-by: Claude Fable 5.1

  • Update ggml/src/gguf.cpp

Co-authored-by: Johannes Gäßler johannesg@5d6.de

  • Update include/llama.h

Co-authored-by: Johannes Gäßler johannesg@5d6.de

  • llama : error on unaligned mmap of an embedded GGUF, drop test-load-file-ptr

Co-authored-by: Johannes Gäßler johannesg@5d6.de

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.