aws/aws-sdk-pandas 1.9.0

AWS Data Wrangler 1.9.0

on GitHub

Breaking changes

• Global configuration s3fs_block_size was replaced by s3_block_size #370

New Functionalities

• Automatic recovery of Pandas indexes from Parquet files. #366
• Automatic recovery of Pandas time zones from Parquet files. #366
• Optional schema evolution disabling through the new schema_evolution argument. #353

Enhancements

• s3fs dependency was replaced by builtin code. #370
• Significant Amazon S3 I/O speed up for high latency environments (e.g. local, on-premises). #370

Bug Fix

• Improve NaN handling. #362
• Sanitise table name for partitions insertion #360

Docs

• Few updates.

Thanks

We thank the following contributors/users for their work on this release:

@isrsal, @bppont, @weishao-aws, @alexifm, @Digma, @samcon, @TerrellV, @msantino, @alvaropc, @luigift, @igorborgest.

P.S. Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!