Details
common : add common_speculative_is_compat() (#19270)
-
llama : add llama_memory_can_rm_suffix()
-
Revert "llama : add llama_memory_can_rm_suffix()"
This reverts commit d30e59b.
- spec : check if the target context is compatible for spec decoding
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: