Details
spec : various improvements ton ngram-map + docs (#19253)
-
spec: ngram-map and reasoning chats
-
spec: add t_begin and t_accept
-
ngram-map : add internal hash map
-
docs : update ngram-map, add ngram-mod
-
docs : fix ngram-map-k
-
docs : differences between implementations
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: