dlt-hub/dlt 0.3.23

on GitHub

Core Library

• Replace multiprocessing pool with futures executors. Now you can run multi-thread code on Lambda (no more semaphore problems) by @steinitzu in #719
• Support all writer types in parquet normalizer. You can load Arrow/Pandas to any destination by @steinitzu in #704
• Add _dlt_load_id and _dlt_id when loading Arrow/Pandas. @steinitzu in #704
• Pass Arrow/Pandas as data to run method. No need to wrap them in resources. by @rudolfix in #723

Docs

• filesystem/bucket verified source docs by @dat-a-man in #712
• in depth explanation of dlt config and secrets! by @AstrakhantsevaAA in #703
• new example: running chess pipeline in production with retries, trace saving and slack messages by @AstrakhantsevaAA in #711

Sources

• Simple, incremental Kinesis reader by @sehnem dlt-hub/verified-sources#276

Full Changelog: 0.3.22...0.3.23