Details
kv-cache : support V-less cache (#19067)
-
kv-cache : support V-less cache
-
cuda : better check for V_is_K_view
-
cuda : improve V_is_K_view check
-
graph : add comments
-
hparams : refactor
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: