dbt-labs/dbt-spark v1.2.0

dbt-spark 1.2.0

on GitHub

dbt-spark 1.2.0 (July 26, 2022)

Features

• Add grants to materializations (#366, #381)

Fixes

• Pin pyodbc to version 4.0.32 to prevent overwriting libodbc.so and libltdl.so on Linux (#397, #398)
• Incremental materialization updated to not drop table first if full refresh for delta lake format, as it already runs create or replace table (#286, #287)
• Apache Spark version upgraded to 3.1.1 (#348, #349)
• adapter.get_columns_in_relation (method) and get_columns_in_relation (macro) now return identical responses. The previous behavior of get_columns_in_relation (macro) is now represented by a new macro, get_columns_in_relation_raw (#354, #355)

Under the hood

• Update SparkColumn.numeric_type to return decimal instead of numeric, since SparkSQL exclusively supports the former (#380)
• Initialize lift + shift for cross-db macros (#359)
• Add invocation env to user agent string (#367)
• Use dispatch pattern for get_columns_in_relation_raw macro (#365)

Contributors

• @barberscott (#398)
• @grindheim (#287)
• @nssalian (#349)
• @ueshin (#365)
• @dbeatty10 (#359)