4.6.2 (2022-02-16)
Key Bug Fixes
- Fixed an issue preventing preferred regions configured in
spark.cosmos.preferredRegionsList
from being used - See PR 27084 - Fixed
spark.cosmos.changeFeed.itemCountPerTriggerHint
handling when using structured streaming - there was an issue that would reduce the throughput in subsequent micro batches too aggressively. - See PR 27101 - Fixed an issue preventing driver programs to cleanly shutting down due to active Cosmos Clients being cached. - See PR 27137
- Fixed an issue resulting in excessive memory consumption due to unbounded prefetch of data in Spark queries (batch or structured streaming) using the
cosmos.oltp
orcosmos.oltp.changeFeed
connector when the data gets consumed slower than retrieved from the Cosmos DB backend. - See PR 27237 and PR 27261 and PR 27299