MarquezProject/marquez 0.13.0

Marquez 0.13.0

on GitHub

Added

• Secret support for helm chart @KevinMellott91
• New seed cmd to populate marquez database with source, dataset, and job metadata allowing users to try out features of Marquez (data lineage, view job run history, etc) 🎉
• Docs on applying db migrations manually
• New LineageAPI to support data lineage queries 🎉 @henneberger
• Support for logging errors via sentry
• New Airflow example with Marquez 🎉

Changed

• Update OpenLinageDao to stop converting URI structures to contain underscores instead of colons and slashes @collado-mike
• Bump testcontainers dependency to v1.15.2 @ ShakirzyanovArsen
• Register output datasets for a run lazily @henneberger
• Refactor spark plan traversal to find input/output datasets from datasources @collado-mike
• Web UI project settings and default marquez port @phixMe
• Associate dataset inputs on run start @henneberger

Fixed

• Dataset description is not overwritten on update @henneberger
• Latest tags are returned from dataset @henneberger
• Airflow integration tests on forked PRs @mobuchowski
• Empty nominal end time support @henneberger
• Ensure valid dataset fields for OpenLineage @henneberger
• Ingress context templating for helm chart @KulykDmytro