Details
llama-quant : fail early on missing imatrix, refactor type selection, code cleanup (#19770)
-
quantize : imatrix-fail early + code cleanup
-
fix manual override printing
it's in the preliminary loop now, so needs to be on its own line
-
revert header changes per ggerganov
-
remove old #includes
-
clarify naming
rename tensor_quantization to tensor_typo_option to descirbe its
functionality
- fix per barto
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: