This is a major dlt release. Please check the list of breaking changes and deprecations: #1778
Core Library
- move rest_api, sql_database and filesystem sources to dlt core by @willi-mueller in #1728
- drops
foreign_key, adds nested references (row_key-parent_key) by @rudolfix in #1774 - deprecates
complexdata type, changes tojsonby @rudolfix in #1792 - Feat/1749 abort load package and raise exception on terminal errors in jobs by @willi-mueller in #1781
- Feat/1492 extend timestamp config to handle naive timestamps (without timezone) by @donotpush in #1669
- Fix/1571 Incremental: Optionally load or ignore/exclude/include records with
cursor_pathmissing or None value by @willi-mueller in #1576 - creates a single source in extract for all resource instances passed as list by @rudolfix in #1535
- Enable BigQuery schema auto-detection with partitioning and clustering hints by @Pipboyguy in #1806
- Sqlalchemy destination (merge support and docs still in progress) by @steinitzu in #1734
- Feat/1730 extend filesystem sftp by @donotpush in #1769
- Stops dumping secrets to dlt traces. by @willi-mueller in #1797
- Don't use Custom Embedding Functions on LanceDB by @Pipboyguy in #1771
- sets default concurrency for blob upload for adlfs to 1 to avoid massive memory usage on large files by @rudolfix in #1779
- Fix/1790 support incremental load with arrow when cursor column is not nullable by @willi-mueller in #1791
- controls row group size and empty tables in memory buffer when writing parquet by @rudolfix in #1782
- fix installation command" by @novica in #1741
- skips tables without jobs when merging delta tables by @rudolfix in #1803
Docs
- display past versions of the documentation (0.5.x / 1.0.0 / devel) by @sh-rp in #1770
- Refactor filesystem doc by @VioletM in #1745
- Update REST API docs by @akelad in #1795
- Add filesystem tutorial by @VioletM in #1775
- adding the sql_database tutorial by @rahuljo in #1796
- structural and content changes to the sql_database doc by @rahuljo in #1623
- Docs: update the introduction, add the rest_api tutorial by @burnash in #1729
- Docs/update deploy dagster by @mariarice15 in #1761
- Correct wrong code example for apply_hints( incremental(xx) ) by @w0ut0 in #1785
- Moves sources and destinations to the top level in docs navigation by @VioletM in #1750
- Fix typo "frequenly" by @ruudwelten in #1800
- Reorder sidebar by @mariarice15 in #1787
New Contributors
- @novica made their first contribution in #1741
- @mariarice15 made their first contribution in #1761
- @w0ut0 made their first contribution in #1785
- @ruudwelten made their first contribution in #1800
Full Changelog: 0.5.4...1.0.0