MarquezProject/marquez 0.43.0

Marquez 0.43.0

on GitHub

Added

• API: refactor the RunDao SQL query #2685 @sophiely
  Improves the performance of the SQL query used for listing all runs.
• API: refactor dataset version query #2683 @sophiely
  Improves the performance of the SQL query used for the dataset version.
• API: add support for a DatasetEvent #2641 #2654 @pawel-big-lebowski
  Adds a feature for saving into the Marquez model datasets sent via the DatasetEvent event type. Includes optimization of the lineage query.
• API: add support for a JobEvent #2661 @pawel-big-lebowski
  Adds a feature for saving into the Marquez model jobs and datasets sent via the JobEvent event type.
• API: add support for streaming jobs #2682 @pawel-big-lebowski
  Creates job version and reference rows at the beginning of the job instead of on complete. Updates the job version within the run if anything changes.
• API/spec: implement upstream run-level lineage #2658 @julienledem
  Returns the version of each job and dataset a run is depending on.
• API: add DELETE endpoint for dataset tags #2698 @davidsharp7
  Creates a new endpoint for removing the linkage between a dataset and a tag in datasets_tag_mapping to supply a way to delete a tag from a dataset via the API.
• Web: add a dataset drawer #2672 @davidsharp7
  Adds a drawer to the dataset column view in the GUI.

Fixed:

• Client/Java: change url path encoding to match jersey decoding #2693 @davidjgoss
  Swaps out the implementation of MarquezPathV1::encode to use the UrlEscapers path segment escaper, which does proper URI encoding.
• Web: fix pagination in the Jobs route #2655 @merobi-hub
  Hides job pagination in the case of no jobs.
• Web: fix empty search experience #2679 @phixMe
  Use of the previous search value was resulting in a bad request for the first character of a search.

Removed:

• Client/Java: remove maven-archiver dependency from the Java client #2695 @davidjgoss
  Removes a dependency from build.gradle that was bringing some transitive vulnerabilities.