What's Changed in Gateway
Gateway/Router Changes (11 commits)
- [router] update router pypi version (#8628) by @slin1237 in #8628
- [router] migrate router from actix to axum (#8479) by @slin1237 in #8479
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) by @oldsharp in #6869
- [router] improve router logs and request id header (#8415) by @slin1237 in #8415
- [router] add different policies for p node and d node (#8395) by @slin1237 in #8395
- [router] add request format unit test (#8300) by @slin1237 in #8300
- [router] add streaming unit test (#8299) by @slin1237 in #8299
- [router] add endpoint unit test (#8298) by @slin1237 in #8298
- [router] fix pd model completion request (#8303) by @slin1237 in #8303
- [router] add common ut infra to mock worker and app (#8295) by @slin1237 in #8295
- fix: sgl-router remove dead code (#8257) by @oldsharp in #8257
New Contributors
- @oldsharp made their first contribution in a730ce816
- @oldsharp made their first contribution in c33499a67
Paths Included
sgl-routerpython/sglang/srt/grpcpython/sglang/srt/entrypoints/grpc_server.py
Full Changelog: gateway-v0.1.6...gateway-v0.1.7