sgl-project/sglang gateway-v0.1.6

Release Gateway-v0.1.6

on GitHub

What's Changed in Gateway

Gateway Changes (12 commits)

• [router] upgade router version to 0.1.6 (#8209) by @slin1237 in #8209
• [router] add ut for pd router (#8208) by @slin1237 in #8208
• [router] add ut for pd request, metrics and config (#8184) by @slin1237 in #8184
• [router] add ut for worker and errors (#8170) by @slin1237 in #8170
• Fix suffix mismatch for the metrics. (#8168) by @Charles-L-Chen in #8168
• [router] allow router to have empty workers (#8160) by @slin1237 in #8160
• [router] router metrics cleanup (#8158) by @slin1237 in #8158
• [router] Refactor router and policy traits with dependency injection (#7987) by @slin1237 in #7987
• [router] add worker abstraction (#7960) by @slin1237 in #7960
• [bugfix] add pd router policy validation (#7904) by @slin1237 in #7904
• [router] Update metrics when request completes (#7899) by @ZhangShuaiyi in #7899
• [router] forward stream_options in request (#7860) by @ZhangShuaiyi in #7860

New Contributors

• @ZhangShuaiyi made their first contribution in 51ae40306
• @Charles-L-Chen made their first contribution in f3d973615

Paths Included

• sgl-router
• python/sglang/srt/grpc
• python/sglang/srt/entrypoints/grpc_server.py

Full Changelog: gateway-v0.1.5...gateway-v0.1.6