What's Changed
- Cherry pick/release 1.5 patches by @kaushikmitr in #2820
- [release-1.5] fix(latencypredictor): reload model in every sync cycle, not just when this worker downloaded by @k8s-infra-cherrypick-robot in #2852
- [release-1.5] Cherry-pick #2848: fix(predictedlatency): keep prefillTokensInFlight from drifting negative by @kaushikmitr in #2853
Full Changelog: v1.5.0-rc.1...v1.5.0-rc.2