Initial support for custom unstructured events and custom contexts, plus a host of other small improvements.
Scala Hadoop Enrich
- Bumped to 0.4.0
- Bumped to Scala Common Enrich 0.3.0 (#497)
- Renamed AnonQuartets to AnonOctets (#498)
- Renamed all Snowplow Hadoop Tests to Specs (#515)
- Added page_url and page_referrer back into ETL's output (#483)
Scala Common Enrich
- Bumped to 0.3.0
- Bumped Argonaut to 6.0.3 (#620)
- Added app and mob as valid platform codes, thanks @kinabalu! (#524)
- Added support for remaining platform codes (#516)
- Updated POJO in Scalding ETL to include new unstructured fields (#362)
- Updated POJO in Scalding ETL to include name_tracker field (#595)
- Extract evn from Tracker Protocol (#604)
- Extract tna from Tracker Protocol (#616)
- Extract and validate unstructured events (#142)
- Extract and validate custom contexts (#426)
- Reformat incoming event and context JSONs (#589)
- Make sure to error a JSON if > length (#567)
EmrEtlRunner
- Bumped to 0.6.0
- Bumped Elasticity to 3.0.2 (#587)
- Allowed AWS VPC selection in EmrEtlRunner (#581)
- Set :visible_to_all_users to true for EMR jobs, thanks @smugryan! (#560)
Redshift
- atomic-def script bumped to 0.3.0
- Migration script added for 0.2.2 to 0.3.0
- Added new unstructured fields to Redshift table definition (#361)
- Changed distkey to be event_id, not domain_userid (#584)
- Added raw page_url and page_referrer into Redshift table (#591)
- Added name_tracker field to Redshift table (#594)
- Converted Redshift varchar(38) for event IDs to char(36) (#282)
Postgres
- atomic-def script bumped to 0.2.0
- Migration script added for 0.1.x to 0.2.0
- Added new unstructured fields to Postgres table definition (#359)
- Added raw page_url and page_referrer into Postgres table (#592)
- Added name_tracker field to Postgres table (#593)
- Converted varchar(36) for event IDs to char(36) (#596)
StorageLoader
- Bumped to 0.2.0
- Added TIMEFORMAT 'auto' to StorageLoader to handle outlier dvce_timestamps (#427)
JavaScript Tracker
- Bumped git submodule to 1.0.1 (#585)
Python Tracker
- Added git submodule pointing to 0.1.0 (#586)