Noteworthy
- Glue Data Quality now supported, checkout the tutorial 🔥
- Delta lake support by @fvaleye
- New DynamoDB
read_items
method by @a-slice-of-py
Features & enhancements
- feat: add read_items to dynamodb module by @a-slice-of-py in #1877
- Add deltalake support in AWS S3 with Pandas by @fvaleye in #1834
- support for pagination for timestream.list_databases list_tables by @cnfait in #1846
- (feat) glue data quality by @kukushking in #1861
- Add unit test for evaluating two rulesets at once by @LeonLuttenberger in #1871
- (enhancement) Minor - wr.redshift.copy - pass through commit_transaction by @kukushking in #1878
- (enhancement): Extend get and update ruleset DQ methods by @jaidisido in #1882
- enhancement: Adding filter to quicksight
delete_all
methods by @malachi-constant in #1913 - enhancement: Support optional
measure_name
inwr.timestream.write()
by @malachi-constant in #1925
Bug fixes
- (fix) Check if timezone is present in column metadata by @kukushking in #1840
- (fix) Include numpy==1.23.4 && poetry update by @kukushking in #1850
- Fix apply_configs decorator causing function signature to be lost by @LeonLuttenberger in #1858
- forward use_threads to _validate_schemas_from_files by @robert-schmidtke in #1869
- (fix) Minor - KeyError in wr.opensearch.seach && cleanup tests by @kukushking in #1879
- (fix): missing timestamp data type in Timestream by @jaidisido in #1881
- Fix the Athena cache unit test errors by @LeonLuttenberger in #1883
- (fix): Handle None in databases data types by @jaidisido in #1892
Documentation
- Document the create_csv_table function's sensitivity to column order by @LeonLuttenberger in #1923
- (docs) Add extension for ipython console highlighting by @kukushking in #1841
- (feat) Minor - add sphinx copy button for code blocks by @kukushking in #1854
Tests
- Test infra: Add NAT gateway IP addresses to base stack SSM parameters by @LeonLuttenberger in #1847
- Testing: Update Opensearch test output and fixture by @malachi-constant in #1848
- (test-infra) Enable SSE, enforce HTTPS, enable node-to-node encryption by @kukushking in #1851
- (tests) add workaround to enable deltalake to use AWS profile creds by @kukushking in #1934
- Enable warn_unused_ignores for MyPy by @LeonLuttenberger in #1860
- Increase coverage for dynamodb write by @LeonLuttenberger in #1893
- Add tests for S3 wait functions by @LeonLuttenberger in #1896
- Increase coverage for s3.delete* by @LeonLuttenberger in #1897
- Increase S3 tests coverage by @jaidisido in #1909
- Add coverage report to tox by @LeonLuttenberger in #1874
- Add coverage section to pyproject by @jaidisido in #1911
- Deps: Update wheel 0.37.1 -> 0.38.1 by @malachi-constant in #1904
- Add minimum coverage by @LeonLuttenberger in #1927
- refactor: quicksight test resources as fixtures by @malachi-constant in #1928
New Contributors
- @fvaleye made their first contribution in #1834
- @robert-schmidtke made their first contribution in #1869
- @a-slice-of-py made their first contribution in #1877
Thanks
We thank the following contributors/users for their work on this release:
@jaidisido, @kukushking, @LeonLuttenberger, @cnfait, @malachi-constant, @mdavis-xyz, @dydc, @enricomarchesin
Full Changelog: 2.18.0...2.19.0