github kedro-org/kedro 0.19.0

latest releases: 0.19.6, 0.19.0.post1, 0.19.1.post1...
6 months ago

🚀 Major Features and improvements

  • Dropped Python 3.7 support.
  • Introduced project tools and example to the kedro new CLI flow.
  • The new spaceflights starters, spaceflights-pandas, spaceflights-pandas-viz, spaceflights-pyspark, and spaceflights-pyspark-viz can be used with the kedro new command with the --starter flag.
  • Added the --conf-source option to %reload_kedro, allowing users to specify a source for project configuration.
  • Added the functionality to choose a merging strategy for config files loaded with OmegaConfigLoader.
  • Modified the mechanism of importing datasets, raise more explicit error when dependencies are missing.
  • Added validation for configuration file used to override run commands via the CLI.
  • Moved the default environment base and local from config loader to _ProjectSettings. This enables the use of config loader as a standalone class without affecting existing Kedro Framework users.

🪲 Bug fixes and other changes

  • Added a new field tools to pyproject.toml when a project is created.
  • Reduced spaceflights data to minimise waiting times during tutorial execution.
  • Added validation to node tags to be consistent with node names.
  • Removed pip-tools as a dependency.
  • Accepted path-like filepaths more broadly for datasets.

💥 Breaking changes

  • Removed ConfigLoader and TemplatedConfigLoader.
  • Removed kedro.extras.datasets and tests (use kedro-datasets instead)
  • Removed PartitionedDataset and IncrementalDataset from kedro.io (import them from kedro-datasets instead)
  • logging is removed from OmegaConfigLoader in favour of the environment variable KEDRO_LOGGING_CONFIG.
  • Removed support for defining the layer attribute at top-level within DataCatalog.
  • Renamed data_set and DataSet to dataset and Dataset everywhere.
  • Removed the create_default_data_set() method in the Runner in favour of using dataset factories to create default dataset instances.
  • The default project template now has only one pyproject.toml at the root of the project (containing both the packaging metadata and the Kedro build config).

✍️ Documentation changes

  • Added new top navigation to easily switch between Framework, Viz, and Datasets.
  • Added new search-as-you-type to improve the search experience.

New Contributors

Full Changelog: 0.18.14...0.19.0

🚨 If you are upgrading from Kedro 0.18, have a look at the migration guide.

We welcome every community contribution, large or small. See what we're working on now and report bugs or suggest future features.
Until next time,
The Kedro Team 💛

Don't miss a new kedro release

NewReleases is sending notifications on new releases.