github xorbitsai/inference v2.9.0

3 hours ago

What's new in 2.9.0 (2026-05-23)

These are the changes in inference v2.9.0.

New features

Enhancements

Bug fixes

  • fix(ocr): replace eval() with ast.literal_eval in deepseek_ocr coordinate parsing by @Ricardo-M-L in #4872
  • fix: harden docs workflow against branch injection by @qinxuye in #4910
  • fix(ci): harden gen docs workflow by @rogercloud in #4913
  • fix: Fix tool_call messages handling in utils.py by @la1ty in #4915
  • fix(ci): update vllm to 0.21.0 for Dockerfile by @zwt-1234 in #4934

Documentation

New Contributors

Full Changelog: v2.8.0...v2.9.0

Don't miss a new inference release

NewReleases is sending notifications on new releases.