4.24.0 (2023-12-01)
Features Added
- Added hierarchical partition key support. See PR 37184
- Added
bytesWritten
andrecordsWritten
metrics in the sink of the Azure Cosmos DB connector. - See PR 37510
Other Changes
- Improved DirectTcp config Defaults for Spark workloads - transit timeout health checks as well as request and connect timeout are too aggressive considering that many Spark jobs unlike latency sensitive apps is throughput optimized and executors will often hit CPU usage >70%. - See PR 37878