github dlt-hub/dlt 1.4.1

latest release: 1.5.0
18 days ago

Bugfixes

We release important bugfix and define identifier normalization behavior for compound identifiers. practically

  • identifiers that contain double underscores will be allowed
  • all existing schemas (ie. stored at destination) will be set to work in backward-compatible mode

read more here: https://dlthub.com/docs/devel/general-usage/naming-convention#compound-flattened-identifiers

  • #2087 allows double underscores in identifiers by @rudolfix in #2098
  • Fixes the usage of escaped JSONPath in incremental cursors in sql_database by @burnash in #2077
  • Fix/2089 support sets for pyarrow backend by @karakanb in #2090
  • allow to increase total count on most progress bars, fixes incorrect output in load stage by @sh-rp in #2100

Core Libary

  • Support custom Ollama Host by @Pipboyguy in #2044
  • feat(rest_api): custom client for specific resources by @joscha in #2082
  • Support Spatial Types for PostGIS by @Pipboyguy in #1927
  • Incremental table hints and incremental in resource decorator by @steinitzu in #2033
  • supports custom account host for azure (#2073 ) and fixes various edge cases for abfss @rudolfix

Core Sources

adds engine adapter and passes incremental and engine to query adapter by @rudolfix in #2070

  • adds engine adapter callback to modify engine settings before connection is opened (hopefully fixes #1920)
  • allows to return a subquery for table adapter, adds example that fixes #2076
  • passes Incremental and Engine instances to query adapter callback
  • allows to return text query from engine adapter #1997
  • arrow backend now infers not reflected columns from the data

(Still) experimental interfaces

  • allow to select schema from pipeline dataset factory by @sh-rp in #2075
  • ibis support - hand over credentials to ibis backend for a number of destinations by @sh-rp in #2004

Docs

New Contributors

Full Changelog: 1.4.0...1,4,1

Don't miss a new dlt release

NewReleases is sending notifications on new releases.