dbt-labs/dbt-spark v1.9.0

dbt-spark v1.9.0

on GitHub

dbt-spark 1.9.0 - December 10, 2024

Breaking Changes

• Drop support for Python 3.8 (#1121)

Features

• Add tests for cross-database cast macro (#1028)
• Cross-database date macro (#1031)
• Allow configuring snapshot column names (#1096)
• Support custom ODBC connection parameters via connection_string_suffix config (#1092)
• Add Microbatch Strategy to dbt-spark (#1109)
• Enable setting current value of dbt_valid_to (#1112)

Fixes

• Fix incremental python models error where Databricks could not find the temp table transaction logs (#1033)

Under the Hood

• Lazy load agate to improve performance (#1049)
• Isolating distribution testing (#1069)

Dependencies

• Update freezegun requirement from ~=1.3 to ~=1.4 (#966)
• Bump actions/download-artifact from 3 to 4 (#1010)
• Bump actions/upload-artifact from 3 to 4 (#1011)
• Bump dbt-labs/actions from 1.1.0 to 1.1.1 (#1012)
• Update wheel requirement from ~=0.42 to ~=0.43 (#1035)
• Update pytest-xdist requirement from ~=3.5 to ~=3.6 (#1073)
• Loosen pin on pre-commit from 3.7.0 to 3.7 (#1074)

Contributors

• @jpoley (#1092)
• @leahwicz (#1069)
• @nilan3 (#1092)