Azure/azure-sdk-for-java azure-cosmos-spark_3-1_2-12_4.23.0

on GitHub

4.23.0 (2023-10-09)

Features Added

• Added configuration option to control the maximum batch size used - by default the batch size is determined automatically based on the throttling rate - and will auto-adjust to meet the throughput control limits when applied. This setting is mostly added to simplify Spark 2.4 migrations where it was possible to specify a fixed batch size. This setting should only be used when not enabling throughput control - and for new workloads not being migrated from Spark 2.4 using throughput control is preferred. See PR 37072

Bugs Fixed

• Fixed an issue with backpressure when using WriteStrategy ItemBulkUpdate - with this write strategy a Reactor operator bufferTimeout was used, which has issues when backpressure happens and can result in an error verflowException: Could not emit buffer due to lack of requests. See PR 37072