jina-ai/serve v3.22.0

💫 Release v3.22.0

on GitHub

Release Note (3.22.0)

Release time: 2023-10-04 12:16:53

This release contains 1 new feature and 2 documentation improvements.

🆕 Features

Change the way dynamic batching is handled (#6066)

This release implements some changes in the way we handle dynamic batching:

• Jina guarantees that all the batches passed to Executors contain no more than preferred_batch_size documents.
• Requests are returned to the client as they are processed without waiting for other requests to be ready.

📗 Documentation Improvements

• Fix dynamic batching documentation (#6068)
• Fix line explaining dynamic batching in YAML (#6065)

🤟 Contributors

We would like to thank all contributors to this release:

• Joan Fontanals (@JoanFM)
• Johannes Messner (@JohannesMessner )