We are excited to announce the release of Delta Lake 3.3.1! This release contains a few bug fixes to the 3.3.0 release and it is recommended that users upgrade to 3.3.1.
Component specific bug fixes are detailed below.
Delta Spark
Delta Spark 3.3.1 is built on Apache Spark™ 3.5.3. Similarly to Apache Spark, we have released Maven artifacts for both Scala 2.12 and Scala 2.13.
- Documentation: https://docs.delta.io/3.3.1/index.html
- API documentation: https://docs.delta.io/3.3.1/delta-apidoc.html#delta-spark
- Maven artifacts: delta-spark_2.12, delta-spark_2.13, delta-contribs_2.12, delta_contribs_2.13, delta-storage, delta-storage-s3-dynamodb
- Python artifacts: https://pypi.org/project/delta-spark/3.3.1/
The key fixes in this release are:
- Fix to allow user-specified on read if consistent with the table schema
- Documentation update for Row Tracking to include Row Tracking Backfill introduced in Delta 3.3
Delta Kernel
- API documentation: https://docs.delta.io/3.3.1/api/java/kernel/index.html
- Maven artifacts: delta-kernel-api, delta-kernel-defaults
The key fixes in this release are:
- Kernel fix to handle non-uniform value types in map[string, string] in delta commit files
Other projects
No fixes or changes were made in the components below in this release but the corresponding artifacts are listed.
Delta Universal Format (UniForm)
- Documentation: https://docs.delta.io/3.3.1/delta-uniform.html
- Maven artifacts: delta-iceberg_2.12, delta-iceberg_2.13, delta-hudi_2.12, delta-hudi-2.13
Delta Sharing Spark
- Documentation: https://docs.delta.io/3.3.1/delta-sharing.html
- Artifacts: delta-sharing-spark_2.12, delta-sharing-spark_2.13
Credits
Wenchen Fan, Thang Long Vu