github ggml-org/llama.cpp b8110

latest releases: b8115, b8113, b8112...
2 hours ago
Details

model: Add PaddleOCR-VL model support (#18825)

  • support PaddleOCR-VL

  • clip: update PaddleOCR model loader parameters to prevent OOM during warmup

  • [update] add paddleocr vl text model instead of ernie4.5

  • [update] restore change of minicpmv

  • [update] format

  • [update] format

  • [update] positions and patch merge permute

  • [update] mtmd_decode_use_mrope for paddleocr

  • [update] image min/max pixels

  • [update] remove set_limit_image_tokens

  • upate: preprocess without padding

  • clean up

  • Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

  • Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com


Co-authored-by: Xuan Son Nguyen son@huggingface.co
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

macOS/iOS:

Linux:

Windows:

openEuler:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.