4.10.1 (2022-06-01)
Features Added
- Added ability to disable endpoint rediscovery when using custom domain names in combination with private endpoints from a custom (on-premise) Spark environment (neither Databricks nor Synapse). - See PR 29027
- Added a config option
spark.cosmos.serialization.dateTimeConversionMode
to allow changing date/time conversion to fall back to convertingjava.sql.Date
andjava.sql.Tiemstamp
into Epoch Milliseconds like in the Cosmos DB Connector for Spark 2.4 - See PR 29081
Bugs Fixed
- Fixed possible perf issue when Split results in 410 when trying to get latest LSN in Spark partitioner that could result in reprocessing change feed events (causing "hot partition2") - See PR 29152
- Fixed a bug resulting in ChangeFeed requests using the account's default consistency model instead of falling back to eventual if
spark.cosmos.read.forceEventualConsistency
istrue
(the default config). - See PR 29152