MarquezProject/marquez 0.33.0

Marquez 0.33.0

on GitHub

Added

• API: support inputFacets and outputFacets from Openlineage specification #2417 @pawel-big-lebowski
  Adds the ability to store inputFacets / outputFacets sent within datasets, exposing them through the Marquez API as part of the Run resource.

Fixed

• API: fix job update SQL to correctly use simple_name for job updates #2457 collado-mike
  Fixes a bug in the job update logic stemming from use of the FQN rather than the simple_name and updates the relevant test.
• API: update SQL in backfill script for facet tables to improve performance #2461 collado-mike
  Dramatically improves migration performance by making the backfill script fetch events by run_uuid via a new temp table for tracking and sorting runs.
• API: update v61 migration to handle duplicate job names before unique constraint #2464 collado-mike
  To fix a bug in the case of duplicate job FQNs, this renames jobs that have been symlinked to point to newer versions of themselves so that the job FQN doesn't conflict and the unique constraint (without regard to parent job) can be applied. Note: Any installations that have already applied this migration will not see any new operations on their data, but installations that have duplicates will need this fix for the migration to complete successfully.
• API: make improvements to lineage query performance #2472 collado-mike
  Dramatically lessens the lineage query performance regression caused by removal of the jobs_fqn table in #2448.
• UI: change color for selected node and edges on graph #2458 tito12
  Improves the visibility of the selected node and edges by increasing the contrast with the background.
• UI: change color for selected node and edges on graph #2458 tito12
  Improves the visibility of the selected node and edges by increasing the contrast with the background.
• UI: Handle null run.jobVersion in DatasetInfo.tsx to fix rendering issues. [#2471] (#2471) perttus
  In some cases Marquez UI fails to render DatasetInfo, this addresses that issue.
• UI: better handling of null job latestRun for Jobs page #2467 perttus
  Fixes a bug where Jobs view fails to load where some jobs don't have latestRun.