Changelog

54.2.0 (2025-02-12)

Full Changelog

Implemented enhancements:

• Casting from Utf8View to Dict(k, Utf8View) #7114
• Support creating map arrays with key metadata #7100 [arrow]
• [parquet] Print Parquet BasicTypeInfo id when present #7081 [parquet]
• Add arrow-ipc benchmarks for the IPC reader and writer #6968 [arrow]

Fixed bugs:

• NullBufferBuilder::allocated_size Returns Size in Bits #7121 [arrow]
• [Regression in 54.0.0]. Decimal cast to smaller precision gives invalid (off-by-one) result in some cases #7069 [arrow]
• Minor: Fix deprecated note to point to the correct const #7067 [arrow]
• incorrect error message for reading definition levels #7056 [parquet]
• First None in ListArray panics in cast_with_options #7043 [arrow]

Documentation updates:

• Minor: Clarify documentation on NullBufferBuilder::allocated_size #7089 [arrow] (alamb)
• Minor: Update release schedule #7086 (alamb)
• Improve ListArray documentation for slices #7039 [arrow] (alamb)

Merged pull requests:

• fix: NullBufferBuilder::allocated_size should return Size in Bytes #7122 [arrow] (shuozel)
• minor: fix deprecated_note #7105 [arrow] (Chen-Yuan-Lai)
• Minor: Fix ArrayDataBuilder::build_unchecked docs #7103 [arrow] (gstvg)
• Support setting key field in MapBuilder #7101 [arrow] (rshkv)
• Add tests that arrow IPC data is validated #7096 [arrow] (alamb)
• Print Parquet BasicTypeInfo id when present #7094 [parquet] (devinrsmith)
• Expose record boundary information in JSON decoder #7092 [arrow] (scovich)
• Benchmarks for Arrow IPC reader #7091 [arrow] (alamb)
• Benchmarks for Arrow IPC writer #7090 [arrow] (alamb)
• Add another decimal cast edge test case #7078 [arrow] (findepi)
• minor: re-export OffsetBufferBuilder in arrow crate #7077 [arrow] (alamb)
• Support converting large dates (i.e. +10999-12-31) from string to Date32 #7074 [arrow] (phillipleblanc)
• fix: issue introduced in #6833 - less than equal check for scale in decimal conversion #7070 [arrow] (himadripal)
• perf: inline from_iter for ScalarBuffer #7066 [arrow] (0ax1)
• fix: first none/empty list in ListArray panics in cast_with_options #7065 [arrow] (irenjj)
• Minor: add ticket reference for todo #7064 [parquet] (alamb)
• Refactor some decimal-related code and tests #7062 [arrow] (CurtHagenlocher)
• fix error message for reading definition levels #7057 [parquet] (jp0317)
• Update release schedule README.md #7053 (alamb)
• Support both 0x01 and 0x02 as type for list of booleans in thrift metadata #7052 [parquet] (jhorstmann)
• Refactor arrow-ipc: Move create_*_array methods into RecordBatchDecoder #7029 [arrow] (alamb)
• Refactor arrow-ipc: Rename ArrayReader to RecodeBatchDecoder #7028 [arrow] (alamb)
• Introduce UnsafeFlag to manage disabling ArrayData validation #7027 [arrow] (alamb)

* This Changelog was automatically generated by github_changelog_generator