Details
quantize: add option --tensor-type-file to llama-quantize (#18572)
-
add option --tensor-type-file to llama-quantize, but it raises an error.
-
add error message when file not found
-
quantize: update help menu, fix CI
Signed-off-by: Aaron Teo aaron.teo1@ibm.com
Signed-off-by: Aaron Teo aaron.teo1@ibm.com
Co-authored-by: Your Name you@example.com
Co-authored-by: Aaron Teo aaron.teo1@ibm.com
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: