MarquezProject/marquez 0.48.0

Marquez 0.48.0

on GitHub

Added

• API: add endpoint method and path to metrics name #2850 @JDarDagran
  In the metrics endpoint, there was information gathered containing the SQL Object name and method name. This introduces labels (DAO name, DAO method, endpoint method, endpoint path) and adds more information about endpoints.
• API: add paging to dataset versions panel #2855 @davidsharp7
  Adds Datasets paging.
• API: add paging on Jobs panel #2852 @davidsharp7
  Adds Job-level paging of Runs.
• API: add Dataset schema versions #2763 @davidjgoss
  Adds Dataset schema versions to the model and enables writing to it.
• Docker: make db port configurable via POSTGRES_PORT #2751 @merobi-hub
  Adds support for easy db port reassignment.
• Java: allow customization of Apache HTTP in Java client #2822 @davidjgoss
  Allows customization of Apache HTTP in Java client.
• Web: add Job tagging to UI #2837 @davidsharp7
  Adds Job tagging to the UI.
• Web: source code facets #2833 @phixMe
  Adds typedef and rendering of the sourceCode facet for a Job if available.

Fixed

• API: Dataset query to get only the latest facet for each version #2859 @sophiely
  The facet partition is ranked by Dataset version and facet name so as we can take only the most recent facet for each Dataset UUID and type.
• API: optimize column lineage query performance #2821 @vinhnemo
  Adds a filter condition to the CTE dataset_fields_view in ColumnLineageDao.java.
• Web: deduplicate the versions displayed #2854 @namyyys
  Excludes the symlinks from the result of the query displaying the version history in order to exclude duplicate versions.
• Web: clean up issues highlighted by some Spark Integration Data #2856 @phixMe
  Fixes numerous issues in our interfaces related to some OpenLineage Spark events.
• Web: remove limit from assertion evaluation #2844 @phixMe
  Fixes bug where our status indicator was the wrong color.
• Web: bring Dataset tags into line with Job Tags #2841 @davidsharp7
  Brings Dataset tags into line with Job tags.
• Web: fix scroll issues for drawer and home pages #2820 @phixMe
  Scrolling improvements for drawer and home pages.
• Web: fix search endpoint parameters #2818 @Nisarg-Chokshi
  The search API parameters were not getting updated correctly on changing the filter and sort options.

Removed

• Web: DRY paging #2832 @phixMe
  Removes repeated code for paging on lineage events, jobs and datasets.