Azure/azure-sdk-for-java azure-cosmos-spark_3-2_2-12_4.24.0

on GitHub

4.24.0 (2023-12-01)

Features Added

• Added hierarchical partition key support. See PR 37184
• Added bytesWritten, recordsWritten and cosmos.totalRequestCharge metrics in the sink of the Azure Cosmos DB connector. - See PR 37510

Other Changes

• Improved DirectTcp config Defaults for Spark workloads - transit timeout health checks as well as request and connect timeout are too aggressive considering that many Spark jobs unlike latency sensitive apps is throughput optimized and executors will often hit CPU usage >70%. - See PR 37878