Bugfixes
We release important bugfix and define identifier normalization behavior for compound identifiers. practically
- identifiers that contain double underscores will be allowed
- all existing schemas (ie. stored at destination) will be set to work in backward-compatible mode
read more here: https://dlthub.com/docs/devel/general-usage/naming-convention#compound-flattened-identifiers
- #2087 allows double underscores in identifiers by @rudolfix in #2098
- Fixes the usage of escaped JSONPath in incremental cursors in sql_database by @burnash in #2077
- Fix/2089 support sets for pyarrow backend by @karakanb in #2090
- allow to increase total count on most progress bars, fixes incorrect output in load stage by @sh-rp in #2100
Core Libary
- Support custom Ollama Host by @Pipboyguy in #2044
- feat(rest_api): custom client for specific resources by @joscha in #2082
- Support Spatial Types for PostGIS by @Pipboyguy in #1927
- Incremental table hints and incremental in resource decorator by @steinitzu in #2033
- supports custom account host for azure (#2073 ) and fixes various edge cases for abfss @rudolfix
Core Sources
adds engine adapter and passes incremental and engine to query adapter by @rudolfix in #2070
- adds engine adapter callback to modify engine settings before connection is opened (hopefully fixes #1920)
- allows to return a subquery for table adapter, adds example that fixes #2076
- passes Incremental and Engine instances to query adapter callback
- allows to return text query from engine adapter #1997
- arrow backend now infers not reflected columns from the data
(Still) experimental interfaces
- allow to select schema from pipeline dataset factory by @sh-rp in #2075
- ibis support - hand over credentials to ibis backend for a number of destinations by @sh-rp in #2004
Docs
- Updated sql_database documentation for resource usage by @dat-a-man in #2072
- Docs: improve links visibility in light mode by @burnash in #2078
- edit snippet to make more runnable (#2066) by @AstrakhantsevaAA in #2079
- Docs: update deprecated paginator type in examples by @burnash in #2093
- Move "dlt in notebooks" by @AstrakhantsevaAA in #2096
- docs: document that
path
can also be a URL by @joscha in #2099 - Fix minor typo :3 by @jdbohrman in #2103
- 🐛 Fix parquet layout example in the docs by @trymzet in #2105
- docs(rest_client): note about
data_selector
by @joscha in #2101
New Contributors
- @joscha made their first contribution in #2099
- @karakanb made their first contribution in #2090
- @jdbohrman made their first contribution in #2103
- @trymzet made their first contribution in #2105
Full Changelog: 1.4.0...1,4,1