snowplow/snowplow r64-palila

Release 64 Palila

on GitHub

Adds a new data modeling stage to the Snowplow pipeline, as well as fixes a small number of important bugs across the rest of Snowplow

• Blog post

Common

• Added top-level data modeling folder (#1523)
• Updated root README to include data modeling (#1612)

ActionScript 3.0 Tracker

• Added git submodule (#1546)

EmrEtlRunner

• Bumped to 0.14.0
• Bumped Elasticity to 4.0.5 (#758)
• Added support for specifying EMR service role (#1595)
• Added support for specifying EMR jobflow role (#1232)

Scala Common Enrich

• Bumped to 0.13.1
• Prevented UaParserEnrichment from creating a new Parser on every event (#1616)

Scala Hadoop Enrich

• Bumped to 0.14.1
• Bumped Scala Common Enrich to 0.13.1 (#1617)

Redshift

• Increased mkt_clickid to varchar(128) (#1605)
• Added migration script for 0.5.0 to 0.6.0 (#1606)
• Removed legacy cubes (#1613)

Postgres

• Increased mkt_clickid to varchar(128) (#1603)
• Added migration script for 0.4.0 to 0.5.0 (#1604)
• Removed legacy cubes (#1614)
• Added user_id field to migration script for 0.3.0 to 0.4.0 (#1620)

Data Modeling

• Updated reference data.iso_country_codes so DISTSTYLE is ALL (#1393)

SQL Runner

• Added basic sessions / visits / page views model that can be pivoted on directly from any BI tool (#1273)

Looker

• Simplified LookML model and made it consistent with Redshift data models (#1522)