jorgecarleitao/arrow2 v0.12.0

on GitHub

A new version of arrow2 is now available in crates.io. 🎉🎉🎉

See below all great things that were released 🚀. But before that, thank you so much to everyone that contributed to this release: 🙇

@ahmedriza, @dexterduck, @GPSnoopy, @HaoYang670, @SimonSchneider, @TurnOfACard, @aptr322, @arxra, @b41sh, @cjermain, @dbr, @jorgecarleitao, @ritchie46

Breaking changes:

• Require one encoding per parquet column on write #1012
• Bumped parquet2 #1035 (jorgecarleitao)
• Improved performance of deserializing JSON (2x) #1024 (jorgecarleitao)
• Remove from_trusted_len_* from Buffer #1020 (jorgecarleitao)
• Bumped arrow-format #1011 (jorgecarleitao)
• Replace fn Offset::is_large() as const Offset::IS_LARGE #1002 (HaoYang670)
• Renamed ArrowError to Error #993 (jorgecarleitao)

New features:

• Added support to deserialize MapArray from parquet #1045 (jorgecarleitao)
• Added support for random access reads from IPC #1034 (jorgecarleitao)
• Added support for custom sort build_compare_fn #1016 (b41sh)
• Added support to write nested parquet #1007 (jorgecarleitao)
• Added support for deserializing JSON from iterator #989 (cjermain)

Fixed bugs:

• Writing of ListArray does not preserve all values #1008
• Write a two-dimensional list to parquet file failed #992
• Writing to Parquet fails for extension types that contain lists #830
• Fixed using lower limit than size of first parquet row group #1046 (arxra)
• Fixed error in consuming sliced FixedSizedBinary from c data interface (FFI) #1026 (jorgecarleitao)
• Fixed lexsort limit equal or greater than row_count #1021 (b41sh)
• Fixed error in reading nested parquet structs #1015 (jorgecarleitao)
• Fixed panic on debug print of invalid timezones #1013 (jorgecarleitao)
• Treat empty timezone string as no-timezone #1009 (dbr)
• Fixed encoding of NaN to json #990 (SimonSchneider)
• Fixed error in writing ListArray to parquet #984 (jorgecarleitao)
• Fixed decoding Binary Plain pages with dictionary pages #982 (aptr322)

Enhancements:

• Added Debug and PartialEq for MapArray #1043 (jorgecarleitao)
• Exposed compression levels for parquet #1041 (ritchie46)
• Added .arced/.boxed to arrays #1040 (jorgecarleitao)
• Added utility to create encodings #1018 (jorgecarleitao)
• Made parquet_to_arrow_schema public #1006 (martingallagher)
• Speeded up min_max_boolean for the case where all values are null #1005 (HaoYang670)
• Simplified min_max_string and min_max_binary #1004 (HaoYang670)
• Added support for Decimal in build_compare #998 (GPSnoopy)
• remove accidental quadratic null_count #991 (ritchie46)
• Aligns MutableDictionaryArray's with MutablePrimitiveArrays with TryPush #981 (TurnOfACard)

Documentation updates:

• Cleaned docs for BinaryArray #1047 (jorgecarleitao)
• Improved API docs for MutableBitmap #1025 (jorgecarleitao)
• Improved docs for bitmap #1022 (jorgecarleitao)
• Improved API docs for PrimitiveArray and Utf8Array #1017 (jorgecarleitao)
• Fixed dev guide #1003 (jorgecarleitao)

Testing updates:

• Added more tests #1029 (jorgecarleitao)
• Moved coverage reporting to cargo-llvm-cov #1028 (jorgecarleitao)
• Added more tests (increase coverage) #1027 (jorgecarleitao)
• Moved tests from lib to tests #1001 (jorgecarleitao)
• Allowed feature-specific test runs #985 (jorgecarleitao)