Details
server : Cmdline arg -to changes http read timeout from current 600sec default (#18279)
-
Prevent crash if TTFT >300sec, boosted to 90 days
-
server : allow configurable HTTP timeouts for child models
-
server : pass needed timeouts from params only
Co-authored-by: Greg Slocum fromgit@wbtek.slocum.net
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: