dlt-hub/dlt 0.2.0a29

0.2.0.a29

on GitHub

What's Changed

• Allow changing write_disposition in the resource without dropping dataset by @burnash in #205
• Add a suffix to the default dataset name by @burnash in #207
• improves and adds several dlt pipeline commands: info, trace, load-package, failed-jobs and sync (https://dlthub.com/docs/command-line-interface#dlt-pipeline)
• extends LoadInfo to include the schema changes applied to destination and a list of loaded package infos (https://dlthub.com/docs/running-in-production/running#inspect-save-and-alert-on-schema-changes)
• extends load info with raise_on_failed_jobs and has_failed_jobs to make handling failed jobs easier
• LoadInfo and pipeline.last_trace can be directly loaded into destination to store more metadata on each load (https://dlthub.com/docs/running-in-production/running#inspect-and-save-the-load-info-and-trace)
• adds retry strategy for tenacity to retry load pipeline step (or any other per request) (https://dlthub.com/docs/running-in-production/running#handle-exceptions-failed-jobs-and-retry-the-pipeline)
• raise_on_failed_jobs config option aborts the load package on first failed jobs (https://dlthub.com/docs/running-in-production/running#failed-jobs)

What's Changed in docs

• Fix typos and wording in docs/concepts/state by @burnash in #200
• Fix a broken link in README.md by @burnash in #203
• replacing team@ with community@ by @TyDunn in #211
• GitHub and Google Sheets setup guides by @AmanGuptAnalytics in #195
• "run a pipeline" troubleshooting & walkthrough https://dlthub.com/docs/walkthroughs/run-a-pipeline
• "run a pipeline in production": https://dlthub.com/docs/running-in-production/running
• dlt pipeline command: https://dlthub.com/docs/command-line-interface#dlt-pipeline

Full Changelog: 0.2.0a28...0.2.0a29