snowplow/snowplow r95-ellora

Release 95 Ellora (2017-11-13)

on GitHub

ZSTD support

• Blog post

Redshift

• Add migration script for 0.8.0 to 0.9.0 (#3440)
• Widen domain_sessionidx column in atomic.events from smallint to integer (#1788)
• Update atomic.events to use ZSTD compression (#3435)

EmrEtlRunner

• Bump to 0.29.0 (#3469)
• Reintroduce processing directory not empty no-op (#3458)
• Retrieve the correct latest run ID during archive_shredded step (#3436)
• Fix pagination issue when retrieving latest run id (#3434)
• Update rdb_loader version in config.yml.sample to 0.14.0 (#3418)
• Update rdb_shredder version in config.yml.sample to 0.13.0 (#3460)
• Update spark_enrich version in config.yml.sample to 1.10.0 (#3461)
• Bump AMI version in example config to 5.9.0 (#3465)
• Force bundler 1.15.4 during CI/CD (#3493)

Spark Enrich

• Overwrite output datasets (#3443)
• Bump to 1.10.0 (#3428)
• Add test for Cloudfront Sep 2016 (#3000)
• Bump scala-common-enrich to 0.27.0 (#3427)
• Bump Spark to 2.2.0 (#3466)

Scala Common Enrich

• Bump to 0.27.0 (#3429)
• Add support for new field in CloudFront access logs (#2933)

Web model

• Moved to https://github.com/snowplow/web-data-model (#3471)

Misc

• Add GCP mirror into config/iglu_resolver.json (#3430)
• Replace example Postgres storage target configuration with 1-1-0 (#3463)
• Replace example Redshift storage target configuration with 2-1-0 (#3462)