ggml-org/llama.cpp b8682

on GitHub

ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

• ggml: add Q1_0 and Q1_0_g128 1-bit quantization support (CPU)

• add generic fallback for x86

• remove Q1_0 (group size 32)

• rename Q1_0_g128 => Q1_0

• fix Q1_0 LlamaFileType Enum

• Fix trailing spaces; add generic fallback for othre backends

• Apply suggestions from code review

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• fix /r/n spacing + arch-fallback

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com