This release includes the following updates:
Bug Fixes
- Removed incremental logic in the following end models (PR #97):
shopify__discountsshopify__order_linesshopify__ordersshopify__transactions
- Incremental strategies were removed from these models due to potential inaccuracies from incremental runs. For instance, the
new_vs_repeatfield inshopify__orderscould produce incorrect results during incremental runs. To ensure consistency, this logic was removed across all warehouses. If the previous incremental functionality was valuable to you, please consider opening a feature request to revisit this approach.
Upstream Under-the-Hood Updates from shopify_source Package
- (Affects Redshift only) Creates new
shopify_union_datamacro to accommodate Redshift's treatment of empty tables.- For each staging model, if the source table is not found in any of your schemas, the package will create a table with one row with null values for Redshift destinations. There will be no change in behavior in non-Redshift warehouses.
- This is necessary as Redshift will ignore explicit data casts when a table is completely empty and materialize every column as a
varchar. This throws errors in downstream transformations in theshopifypackage. The 1 row will ensure that Redshift will respect the package's datatype casts.
Documentation
- Added Quickstart model counts to README. (PR #96)
- Corrected references to connectors and connections in the README. (PR #96)
Full Changelog: v0.15.0...v0.16.0