sgl-project/sglang gateway-v0.1.9

Release Gateway-v0.1.9

on GitHub

What's Changed in Gateway

Gateway Changes (10 commits)

• [router] upgrade router version to 0.1.9 (#8844) by @slin1237 in #8844
• refactor(sgl-router): Replace once_cell with LazyLock in worker.rs and remove once_cell dependency from Cargo.toml (#8698) by @htiennv in #8698
• [router] fix req handling order, improve serialization, remove retry (#8888) by @slin1237 in #8888
• [router] PD Router Simplification and Reorganization (#8838) by @slin1237 in #8838
• [router] complete router oai spec (#8828) by @slin1237 in #8828
• [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) by @slin1237 in #8744
• [router] introduce dp worker abstraction (#8639) by @slin1237 in #8639
• [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) by @slin1237 in #8714
• [router] minor code clean up and and refactoring (#8711) by @slin1237 in #8711
• [bug] limit bootstrap room to to [0, 2^63 - 1] (#8684) by @slin1237 in #8684

New Contributors

• @htiennv made their first contribution in fd05b5675

Paths Included

• sgl-router
• python/sglang/srt/grpc
• python/sglang/srt/entrypoints/grpc_server.py

Full Changelog: gateway-v0.1.8...gateway-v0.1.9