github databricks/dbt-databricks v1.8.0

latest releases: v1.8.3, v1.8.2, v1.8.1...
one month ago

This release carries a substantial structural change as it is the first release after moving to the new 'decoupled' dbt architecture; while today we retain a dependence on dbt-core so that users do not need to install/specify versions for both libraries, we have moved to depending on a shared abstraction layer between the adapter and dbt-core. As a result, we no longer need to match our feature version to that of dbt-core, and are free to adopt semantic versioning. No more releasing significant features like 'compute-per-model` as a patch version!

This release also brings improvements to the declaration and operation of Materialized Views and Streaming Tables, including the ability to schedule automatic refreshes.

A new feature introduced in this release is support for tags. To distinguish from dbt tags, which are metadata that is often used for selecting models in a dbt operation, these tags are named as databricks_tags in the model configuration.

Big thanks to dbt Labs for significant help during the development and testing of this release.

What's Changed

Features

  • Support on_config_change for materialized views, expand the supported config options (536)
  • Support on_config_change for streaming tables, expand the supported config options (569)
  • Support insert overwrite on SQL Warehouses (623)
  • Support Databricks tags at model level for tables/views/incrementals (631)

Under the Hood

  • Upgrade databricks-sql-connector to 3.1.0 (593)
  • Migrate to decoupled architecture (596)
  • Finish migrating integration tests (623)
  • Streamline the process of determining materialization types (655)
  • Improve catalog performance by getting column description from project for UC (658)

Don't miss a new dbt-databricks release

NewReleases is sending notifications on new releases.