Changelog

56.2.0 (2025-09-19)

Full Changelog

Implemented enhancements:

• [Variant] Add variant to arrow primitives for unsigned integers #8368
• [Variant] [Shredding] Support typed_access for FixedSizeBinary #8335
• [Variant] [Shredding] Support typed_access for Utf8 and BinaryView #8333
• [Variant] [Shredding] Support typed_access for Boolean #8329
• Allow specifying projection in ParquetRecordBatchReader::try_new_with_row_groups #8326
• [Parquet] Expose predicates from RowFilter #8314
• [Variant] Use row-oriented builders in cast_to_variant #8310
• Use apache/arrow-dotnet for integration test #8294
• [Variant] Add Vairant::as_u* #8283
• Add a way to modify WriterProperties #8273
• Dont truncate timestamps on display for Row #8265
• [Parquet] Add row group write with AsyncArrowWriter #8261
• [Parquet] Expose ArrowRowGroupWriter #8259
• [Parquet] Do not compress v2 data page when compress is bad quality #8256 [parquet]
• [Variant] Refactor cast_to_variant #8234
• [Variant]: Implement DataType::Union support for cast_to_variant kernel #8195
• [Variant]: Implement DataType::Duration support for cast_to_variant kernel #8194
• [Variant] Support typed access for numeric types in variant_get #8178
• [Parquet] Implement a "push style" API for decoding Parquet Metadata #8164
• [Variant] Support creating Variants with pre-existing Metadata #8152
• [Variant] Support Shredded Objects in variant_get: typed path access (STEP 1) #8150
• [Variant] Add variant feature to parquet crate #8132
• [Parquet] Concurrent writes with ArrowWriter.get_column_writers should parallelize across row groups #8115
• [Variant] Implement VariantArray::value for shredded variants #8091
• [Variant] Integration tests for reading parquet w/ Variants #8084
• [Variant]: Implement DataType::Map support for cast_to_variant kernel #8063
• [Variant]: Implement DataType::List/LargeList support for cast_to_variant kernel #8060

Fixed bugs:

• Casting floating point numbers fails for Decimal64 but works for other variants #8362
• [Variant] cast_to_variant conflates empty map with NULL #8289
• [Avro] Decoder flush panics for map whose value field contains metadata #8270
• Parquet: Avoid page size exceeds i32::MAX #8263 [parquet]
• [Avro] Decoder panics on flush when schema contains map whose value is non-nullable #8253
• Avro nullable field decode failure leads to panic upon decoder flush #8212
• Avro to arrow schema conversion fails when a field has a default type that is not string #8209
• parquet: No method named to_ne_bytes found for struct bloom_filter::Block for target s390x-unknown-linux-gnu #8207
• [Variant] cast_to_variant will panic on certain Date64 or Timestamp Values values #8155
• Parquet: Avoid page-size overflows i32 #8264 [parquet] (mapleFU)

Documentation updates:

• Update docstring comment for Writer::write() in writer.rs #8267 [arrow] (YKoustubhRao)

Closed issues:

• comfy-table release 7.2.0 breaks MSRV #8243
• [Variant] Add Variant::as_f16 #8228
• Support appending raw bytes to variant objects and lists #8217
• VariantArrayBuilder uses ParentState for simpler rollbacks #8205
• Make ObjectBuilder::finish signature infallible #8184
• Improve performance of i256 to f64 #8013

Merged pull requests:

• [Variant] Support Variant to PrimitiveArrow for unsigned integer #8369 (klion26)
• [Variant] [Shredding] Support typed_access for Utf8 and BinaryView #8364 [parquet] (petern48)
• Fix casting floats to Decimal64 #8363 [arrow] (AdamGS)
• [Variant] Implement new VariantValueArrayBuilder #8360 (scovich)
• [Variant] Add constants for empty variant metadata #8359 (scovich)
• [Variant] Allow lossless casting from integer to floating point #8357 (scovich)
• [Variant] Minor code cleanups #8356 (scovich)
• [Variant] Remove unused metadata from variant ShreddingState #8355 (scovich)
• Adds Map & Enum support, round-trip & benchmark tests #8353 [arrow] (nathaniel-d-ef)
• [Variant] [Shredding] feat: Support typed_access for FixedSizeBinary #8352 (petern48)
• Add arrow-avro Reader support for Dense Union and Union resolution (Part 1) #8348 [arrow] (jecsand838)
• [Variant] feat: Support typed_access for Boolean #8346 (Weijun-H)
• [Variant] Make VariantToArrowRowBuilder an enum #8345 (scovich)
• [Variant] Rename VariantShreddingRowBuilder to VariantToArrowRowBuilder #8344 (scovich)
• [Variant] Add tests for variant_get requesting Some struct #8343 (scovich)
• [Variant] Add nullable arg to StructArrayBuilder::with_field #8342 (scovich)
• Minor: avoid an Arc::clone in CacheOptions for Parquet PredicateCache #8338 [parquet] (alamb)
• Fix can_cast_types for temporal to Utf8View #8328 [arrow] (findepi)
• Update variant_integration test to use final approved parquet-testing data #8325 [parquet] (alamb)
• [Variant] ParentState tracks builder-specific state in a uniform way #8324 [parquet] (scovich)
• [Variant] Remove boilerplate from make_shredding_row_builder #8322 (scovich)
• [Variant] Move VariantAsPrimitive to type_conversions.rs #8321 (scovich)
• [Variant] Remove unused output builder files #8320 (scovich)
• Add arrow-avro examples and Reader documentation #8316 [arrow] (jecsand838)
• Expose predicates from RowFilter #8315 [parquet] (yeya24)
• [Variant] Implement row builders for cast_to_variant #8299 (scovich)
• Adds additional type support to arrow-avro writer #8298 [arrow] (nathaniel-d-ef)
• Use apache/arrow-dotnet for integration test #8295 (kou)
• Add projection with default values support to RecordDecoder #8293 [arrow] (jecsand838)
• Add array/map/fixed schema resolution and default value support to arrow-avro codec #8292 [arrow] (jecsand838)
• Bump actions/labeler from 6.0.0 to 6.0.1 #8288 (dependabot[bot])
• Bump actions/github-script from 7 to 8 #8287 (dependabot[bot])
• [Variant] Add as_u* for Variant #8284 (klion26)
• [Variant] Support Shredded Objects in variant_get (take 2) #8280 (scovich)
• Bump actions/setup-node from 4 to 5 #8279 (dependabot[bot])
• Bump actions/setup-python from 5 to 6 #8278 (dependabot[bot])
• Bump actions/labeler from 5.0.0 to 6.0.0 #8276 (dependabot[bot])
• Impl Display for Tz #8275 [arrow] (kylebarron)
• Added List and Struct Encoding to arrow-avro Writer #8274 [arrow] (jecsand838)
• Add into_builder method for WriterProperties #8272 [parquet] (corwinjoy)
• chore(parquet/record/field): dont truncate timestamps on display #8266 [parquet] (Erigara)
• [Parquet] Write row group with async writer #8262 [parquet] (lilianm)
• Parquet: Do not compress v2 data page when compress is bad quality #8257 [parquet] (mapleFU)
• Add Decimal32 and Decimal64 support to arrow-avro Reader #8255 [arrow] (jecsand838)
• [Minor] Backport changes to metadata benchmark #8251 [parquet] (etseidl)
• Update hashbrown requirement from 0.15.1 to 0.16.0 #8248 [parquet] [arrow] (dependabot[bot])
• Sort: Change lexsort comment from stable to unstable #8245 [arrow] (mapleFU)
• pin comfy-table to 7.1.2 #8244 [arrow] (zachschuermann)
• Adds Confluent wire format handling to arrow-avro crate #8242 [arrow] (nathaniel-d-ef)
• feat: gRPC compression support for flight CLI #8240 [arrow] [arrow-flight] (crepererum)
• feat: SSLKEYLOGFILE support for flight CLI #8239 [arrow] [arrow-flight] (crepererum)
• [Variant] Refactor cast_to_variant #8235 (liamzwbao)
• [Variant] add strict mode to cast_to_variant #8233 (codephage2020)
• [Variant] Add Variant::as_f16 #8232 (klion26)
• Unpin nightly rust version (MIRI job) #8229 (mbrobbel)
• Update apache-avro requirement from 0.14.0 to 0.20.0 #8226 [arrow] (dependabot[bot])
• Bump actions/upload-pages-artifact from 3 to 4 #8224 (dependabot[bot])
• Added arrow-avro enum mapping support for schema resolution #8223 [arrow] (jecsand838)
• Added arrow-avro schema resolution value skipping #8220 [arrow] (jecsand838)
• Fix error condition in doc comment of Field::try_canonical_extension_type #8216 [arrow] (mbrobbel)
• [Variant]: Implement DataType::Duration support for cast_to_variant kernel #8215 (liamzwbao)
• [Variant] feat: remove unnecessary unwraps in Object::finish #8214 (Weijun-H)
• [avro] Fix Avro decoder bitmap corruption when nullable field decoding fails #8213 [arrow] (yongkyunlee)
• Restore accidentally removed method Block::to_ne_bytes #8211 [parquet] (jhorstmann)
• [avro] Support all default types for avro schema's record field #8210 [arrow] (yongkyunlee)
• [Variant] Support read-only metadata builders #8208 (scovich)
• [Variant] VariantArrayBuilder uses MetadataBuilder and ValueBuilder #8206 (scovich)
• [Variant]: Implement DataType::List/LargeList support for cast_to_variant kernel #8201 (sdf-jkl)
• [Variant]: Implement DataType::Union support for cast_to_variant kernel #8196 (liamzwbao)
• [Variant] Support typed access for numeric types in variant_get #8179 (superserious-dev)
• [Variant] feat: add support for casting MapArray to VariantArray #8177 (Weijun-H)
• Add benchmarks for arrow-avro writer #8165 [arrow] (jecsand838)
• Enable parallel writing across row groups when writing encrypted parquet #8162 [parquet] (rok)
• [Variant] Allow appending raw object/list bytes to variant builders #8141 (scovich)
• Add variant_experimental feature to parquet crate #8133 [parquet] (alamb)
• [Variant] Implement VariantArray::value for shredded variants #8105 (klion26)
• [Parquet] Add ParquetMetadataPushDecoder #8080 [parquet] (alamb)
• improve performance of i256 to f64 #8041 [arrow] (klion26)

* This Changelog was automatically generated by github_changelog_generator