Summary
This release adds custom examples across all databases and adds a buffer for the time filter in snowplow_web_base_events_this_run
for BigQuery to allow for cases when derived_tstamp
< collector_tstamp
. There is also now support for Databricks users with Unity Catalog and added safety around page_view_context deduplication for Redshift and Postgres.
In addition it introduces some updates to the documentation around tearing down a subset of models and adding indexes for Postgres models.
Features
- Add custom examples for all databases (Close #87)
- Add buffer for time filter for BigQuery (Close #98)
- Update docs for tear down issue (Close #100)
- Add support for Databricks users with Unity Catalog (Close #102)
- Add safety page_view_context deduplication for Redshift and Postgres (Close #104)
- Update docs for adding indexes for Postgres (Close #90)
Upgrading
To upgrade simply bump the snowplow-web version in your packages.yml file.
For existing Databricks users only:
Add the following variable to your dbt project's dbt_project.yml file under snowplow_web:
# dbt_project.yml
...
vars:
snowplow_web:
snowplow__databricks_catalog: 'atomic' # the same value as your snowplow__atomic_schema (unless changed it should be 'atomic')