aws/aws-sdk-pandas 3.5.0

AWS SDK for pandas 3.5.0

on GitHub

Breaking changes 💥

Due to CVEs, Ray is capped to patched version 2.9.x. As a result, the latest version of the library cannot be used on the Glue for Ray runtime. We have raised the CVEs issue to the Glue team

Features/Enhancements 🚀

• Add spark_properties to athena spark by @rajagurunath in #2508
• Add MERGE INTO support for Iceberg by @LeonLuttenberger in #2527
• Support partitioning by index cols by @kukushking in #2528
• Add analysis_template_arn to cleanrooms.read_sql_query by @jaidisido in #2584
• Python 3.12 support by @LeonLuttenberger in #2559
  • Note: Ray currently does not support Python 3.12. As such, distributed operations on data frames will not work yet.
  • Relevant Ray issue
• Upgrade to Ray 2.9.0+ and refactor Ray datasources to the new API by @kukushking in #2570

Bug fixes 🐛

• Athena/Neptune minor fixes by @kukushking in #2526
• Reset index and handle last index by @Antropath in #2531
• Oracle failed import message by @matthewdeanmartin in #2537
• Add parameterized queries where possible to address the risk of SQL injection by @LeonLuttenberger in #2540
• SQL identifiers by @kukushking in #2543
• coerce_timestamps - allow None by @kukushking in #2556
• Add validation for table and schema params for Redshift by @LeonLuttenberger in #2551
• Redshift VARBYTE support by @kukushking in #2573

Documentation 📚

• Add SSM Public Param usage to docs by @malachi-constant in #2521

Other 🤖

• refactor: Remove usage of boto3 resources by @LeonLuttenberger in #2525
• chore(deps): bump aiohttp from 3.8.5 to 3.8.6 by @dependabot in #2519
• chore(deps): bump aiohttp from 3.8.6 to 3.9.0 by @dependabot in #2535
• chore(deps): bump cryptography from 41.0.4 to 41.0.6 by @dependabot in #2538
• chore(deps-dev): bump jupyter-server from 2.7.2 to 2.11.2 by @dependabot in #2545
• chore: Upgrade test infrastructure dependencies by @LeonLuttenberger in #2562
• chore: Prepare 3.5.0 release by @LeonLuttenberger in #2560
• chore: Upgrade deltalake dependency by @LeonLuttenberger in #2563
• chore: Replace black formatter with ruff format by @LeonLuttenberger in #2568
• chore: ruff improvements by @LeonLuttenberger in #2571
• chore: upgrade oracledb to 2.0 by @LeonLuttenberger in #2574
• chore(deps-dev): bump the development-dependencies group with 8 updates by @dependabot in #2577
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #2583
• chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in #2590
• chore(deps): bump the production-dependencies group with 5 updates by @dependabot in #2591
• chore: type annotations by @LeonLuttenberger in #2585
• chore: Replace PyLint with Ruff by @LeonLuttenberger in #2588
• chore: Update gremlinpython & add aiohttp by @kukushking in #2595

New Contributors

• @rajagurunath made their first contribution in #2508
• @Antropath made their first contribution in #2531
• @matthewdeanmartin made their first contribution in #2537

Full Changelog: 3.4.2...3.5.0