Details
server: save generated text for the /slots endpoint (for LLAMA_SERVER_SLOTS_DEBUG=1) (#19622)
-
save generated text for the /slots endpoint
-
update debug_generated_text only when LLAMA_SERVER_SLOTS_DEBUG > 0
-
Apply suggestions from code review
Co-authored-by: Matteo matteo@matteo
Co-authored-by: Xuan-Son Nguyen thichthat@gmail.com
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: