github dlt-hub/dlt 1.11.0

latest releases: 1.16.0, 1.15.0, 1.14.1...
3 months ago

Core Library

  • feat: adds iceberg table properties configuration for athena (#2546) by @olexanderos in #2555
  • use pendulum.parse instead of fromisoformat when deserializing pua json to avoid losing timezone info by @sh-rp in #2514
  • #2192 - adds base64 encoded PEM, private_key_path for Snowflake auth, improves docs by @rudolfix in #2569
  • cli: do not use field name as a placeholder name in generated TOML files by @burnash in #2468
  • Speedup CI: Cache google secrets by @sh-rp in #2581
  • Fix: drop corresponding staging table when original table is dropped by @anuunchin in #2567
  • normalize_py_arrow_item now replaces load id column with the right one by @anuunchin in #2526
  • explicit snowflake autocommit=true when connection opens by @rudolfix in #2593
  • list secrets in vault config provider to avoid calls to backend, now it is called only for known keys by @rudolfix in #2597
  • Enabling 'model' loader_file_format for athena, synapse and dremio by @anuunchin in #2556
  • refactor init-command for use in dlt project by @djudjuu in #2568
  • allows to pass config section to dlt.resource, fixes a few edge cases when configs for standalone resources are resolved @rudolfix in #2583
  • enables fsspec per-thread instance cache and updates documentation, this prevents excessive memory usage reported by users by @rudolfix in #2621
  • bumps pendulum to 3.0.1, removes dlt flavored pendulum in Python 3.13 by @rudolfix in #2624
  • Feat/2609-clickhouse-precision-integer-mapping by @hsm207 in #2627
  • removes airflow Airflow DummyOperator import, supports up to v 2.10 by @rudolfix in #2628
  • fixes fsspec instantiation in fs source (where kwargs were ignored) by @rudolfix in #2634

Docs

  • Docs: add documentation for CT columns by @akelad in #2552
  • docs: marimo docs page added by @zilto in #2584
  • athena: fix a typo in the athena_adapter docstring by @burnash in #2599
  • adds proper docs for Google Secrets vault config provider @rudolfix in #2597
  • Extract dataset code snippets into tests snippets system by @sh-rp in #2598
  • fix some typos in cursor-restapi docs by @hsm207 in #2608
  • docs: Fix incorrect nesting in secrets.toml by @agrueneberg in #2614
  • fixes parquet data writer settings docs & rewrites configuration docs by @rudolfix in #2583
  • Added dedup sort example by @dat-a-man in #2235
  • docs: add advanced project tutorial by @sh-rp in #2338
  • docs: split incremental loading page by @burnash in #2592
  • Added info about dlt's internal tables by @dat-a-man in #2525
  • Added section using xmin for Change Data Capture (CDC) to pg_replication docs by @dat-a-man in #2535
  • Added Transform data with add_map documentation by @dat-a-man in #2500
  • cli: fix 404 in the "ai" command output by @burnash in #2643
  • [doc/dlt+] renames sidebar and adds intro snippet for snowflake+ by @rudolfix in #2642

New Contributors

Full Changelog: 1.10.0...1.11.0

Don't miss a new dlt release

NewReleases is sending notifications on new releases.