The first major release of dbt_artifacts! 🎉
This is a complete re-write of the package, using the graph context variable and results on-run-end context variable. It solves multiple issues from pre-v1:
- Overcomes the 16MB variant limit in Snowflake
- Uses an on-run-end hook which always runs no matter the success of the run, mitigating an issue in dbt Cloud where the upload step wouldn't run if the previous step failed
- Makes support for further databases much easier (this release adds Databricks support from the outset)
In addition, performance is greatly improved by avoiding the need to process any json files, and all models are views.
Existing dbt_artifacts <1.0.0 user?
Migration guide and run-operation
If you are listing your config variables under a dbt_artifacts key in dbt_project.yml, this key must be removed and the variables listed as top level keys under vars (why?).
Not this:
vars:
dbt_artifacts:
dbt_artifacts_database: your_db
dbt_artifacts_schema: your_schema
This:
vars:
dbt_artifacts_database: your_db
dbt_artifacts_schema: your_schema
Contributors
Thank you to:
And all those who have tested and provided feedback on the beta releases!