We are excited to announce the release of Delta Lake 3.3.2! This release contains several important bug fixes and improvements to the 3.3.1 release and it is recommended that users upgrade to 3.3.2.
Component specific bug fixes are detailed below.
Delta Spark
Delta Spark 3.3.2 is built on Apache Spark™ 3.5.3. Similarly to Apache Spark, we have released Maven artifacts for both Scala 2.12 and Scala 2.13.
- Maven artifacts: delta-spark_2.12, delta-spark_2.13, delta-contribs_2.12, delta_contribs_2.13, delta-storage, delta-storage-s3-dynamodb
- Python artifacts: https://pypi.org/project/delta-spark/3.3.2/
The key fixes in this release are:
- Fix to clean up stale checksum files during Metadata cleanup to improve table maintenance
Delta Kernel
- Maven artifacts: delta-kernel-api, delta-kernel-defaults
The key fixes in this release are:
- Kernel improvement to eliminate dependencies on package-private Parquet classes for better compatibility with JVM environments with multiple class loaders.
Other projects
Delta Flink (Delta-Standalone based)
- Maven artifacts: delta-flink
The key fixes in this release are:
- Flink fix to correct mapping between Delta's BinaryType and Flink's data types for improved type compatibility.
Credits
Dhruv Arya, Prakhar Jain, Venkateshwar Korukanti, Scott Sandre