github vmware/versatile-data-kit v0.10
Versatile Data Kit 0.10

latest releases: v1.4, v1.3, v1.2...
22 months ago

Summary

Major features include:

vdk-jobs-troubleshooting - new plugin

Introduces thread-dump capabilities in the Data Jobs

See more details in the plugin home page and the VDK Enhancement Proposal

Support for Python 3.11

Introduces support for Python 3.11 in vdk-core and other plugins

Package versions

See installation instructions here.
The versions of VDK components released under VDK 0.10 are:

Main components

control-service 1.5.707959356
vdk-core==0.3.723457889

Plugins

vdk-lineage-model==0.0.723435904
vdk-meta-jobs==0.1.723435904
vdk-sqlite==0.1.730902357
vdk-jobs-troubleshooting==0.2.741769066
vdk-lineage==0.3.723435904
vdk-control-cli==1.3.736732752

What's Changed

  • control-service: add docs on using different versions of k8s by @murphp15 in #1473
  • control-service: fix secret in helm chart by @murphp15 in #1379
  • control-service: graphql wildcard matching filter for team and job names by @mrMoZ1 in #1459
  • control-service: latest graphql version by @murphp15 in #1384
  • control-service: migrate from springfox to springdocs by @murphp15 in #1424
  • control-service: release helm chart with correct image tag by @murphp15 in #1383
  • control-service: reset termination status when job is disabled by @doks5 in #1405
  • control-service: run ci on gradle version change by @murphp15 in #1371
  • control-service: run release test on dependency version change by @tozka in #1400
  • control-service: set registry name correctly. by @murphp15 in #1331
  • control-service: use correct secret type by @murphp15 in #1370
  • control-service: user-agent tag should have the correct format by @murphp15 in #1412
  • examples: clarify README sample anonymize plugin by @tozka in #1394
  • Update README.md by @dimirapetrova in #1373
  • Update README.md for INSERT by @dimirapetrova in #1364
  • vdk-control-cli and some plugins: Support for 3.11 by @tozka in #1409
  • vdk-control-cli: address vulnerability in python dependency by @tozka in #1470
  • vdk-control-cli: allow cli users to explicitly set the user agent tag by @murphp15 in #1403
  • vdk-core: get_managed_connection should return opened connection by @tozka in #1410
  • vdk-core: support for 3.11 by @tozka in #1395
  • vdk-gitlab: upgrade the gitlab runner to latest version by @tozka in #1398
  • vdk-gitlab-runners: increase concurrent pipelines by @tozka in #1396
  • vdk-jobs-trobleshooting: Introduce plugin API and configuration by @doks5 in #1447
  • vdk-jobs-troubleshooting: add thread-dump utility by @doks5 in #1456
  • vdk-jobs-troubleshooting: improve robustness of the plugin by @dakodakov in #1487
  • vdk-jobs-troubleshooting: release the plugin by @dakodakov in #1481
  • vdk-jupyter: splitting functionalities of vdk-notebook Cell class by @duyguHsnHsn in #1465
  • vdk-jupyter: add create job command to jupyter front-end extension by @duyguHsnHsn in #1478
  • vdk-jupyter: add delete job command to jupyter by @duyguHsnHsn in #1488
  • vdk-jupyter: changes on diagrams and definition in notebook-plugin section in VEP by @duyguHsnHsn in #1427
  • vdk-jupyter: create notebook-plugin by @duyguHsnHsn in #1411
  • vdk-jupyter: deleting the yarn.lock file because of security issue by @duyguHsnHsn in #1382
  • vdk-jupyter: notebook-plugin by @duyguHsnHsn in #1415
  • vdk-jupyter: python subprocess security problem by @duyguHsnHsn in #1463
  • vdk-jupyter: run VDK job by @duyguHsnHsn in #1454
  • vdk-jupyter: VEP - adding the definition of Notebook step by @duyguHsnHsn in #1386
  • vdk-lineage, vdk-lineage-model, vdk-meta-jobs: support for Python 3.11 by @tozka in #1448
  • vdk-plugins: introduce vdk-jobs-troubleshooting plugin by @doks5 in #1428
  • vdk-sqlite: support for Python 3.11 by @tozka in #1466
  • vdk-trino: support for Python 3.11 by @tozka in #1471
  • vep-1416: address feedback and update proposal by @doks5 in #1491
  • versatile-data-kit: VEP-1416 vdk-troubleshooting-tools by @doks5 in #1423

New Contributors

Full Changelog: v0.9...v0.10

Don't miss a new versatile-data-kit release

NewReleases is sending notifications on new releases.