github jina-ai/serve v3.27.0
💫 Release v3.27.0

latest releases: v3.27.18, v3.27.17, v3.27.16...
3 months ago

Release Note (3.27.0)

Release time: 2024-07-18 17:00:58

This release contains 1 new feature.

🆕 Features

Add flush-all parameter to dynamic batching configuration (#6179)

You can pass flush_all=True``to the dynamic_batchingconfiguration which will allow to pass all the dynamically batched documents at once to the Executor. This makespreferred_batch_size` parameter a parameter that triggers the flushing but that can be bypassed.

🤟 Contributors

We would like to thank all contributors to this release:

Don't miss a new serve release

NewReleases is sending notifications on new releases.