dbt-labs/dbt-spark v0.17.0

dbt-spark 0.17.0

on GitHub

This is a minor release that tracks dbt==0.17.0.

Breaking Changes

• Always schema, never database. The plugin disallows setting database properties in node configs or target profiles. All values of database are None. In Apache Spark, relational object namespaces have only two components: the object identifier and the database/schema (used interchangeably) in which it is situated. The plugin exclusively uses the schema property to control the behavior related to the database/schema of Spark objects. (#83, #92)

Features

• Add support for dbt snapshot (Delta Lake only) (#76)

Fixes

• The auto-generated docs site (#92):
  • Links the data catalog (information gleaned from the database) to the manifest of models, sources, seeds, and snapshots.
  • Includes metadata about object owner and table size (if available). The groundwork of this feature was originally included in the 0.15.3 release; this information is now visible in the docs site.

Quality of life

• Prettify the README (#82)
• Improved error if running on an older, unsupported Spark version (#87)

Contributors

• @Fokko (#82)
• @tongqqiu (#76)