apache/iceberg apache-iceberg-1.10.1

on GitHub

• API
  • required nested fields within optional structs can produce null by @dejangvozdenac in (#13804)
  • Detect whether required fields nested within optionals can produce nulls by @nastra in (#14270)
• Core
  • Prevent dropping a namespace when it contains views by @nastra in (#14456)
  • Fix overflow due to default value on timestamp nanos by @ebyhr in (#14359)
  • Fix the unpartitioned check in replace partitions by @yuboxx in (#14186)
  • Fix for respecting custom location providers in SerializableTable and actions by @przemekd in (#14280)
  • Fix NAN_VALUE_COUNTS serialization for ContentFile by @huaxingao in (#14721)
  • Handle unknown type during deletes by @nastra in (#14356)
  • REST: Fix validation of PlanTableScanRequest by @nastra in (#14561)
  • REST: Fix validation of PlanTableScanResponse by @nastra in (#14562)
  • REST: Fix RESTFileScanTaskParser to handle empty delete file references list by @ajreid21 in (#14568)
  • REST: Fix serde of tasks with multiple deletes by @singhpk234 in (#14573)
  • REST: Align PlanTableScanRequest filter with the OpenAPI spec by @geruh in (#14658)
  • REST: Make plan status consistent with the REST spec by @singhpk234 in (#14643)
• Parquet
  • Fix NameMapping loss in ParquetUtil.footerMetrics by @tmater in (#14617)
  • Add variant type support to ParquetTypeVisitor by @tmater in (#14588)
  • Fix variant type filtering in ParquetMetricsRowGroupFilter by @geruh in (#14081)
  • handle NPE for VariantLogicalType in TypeWithSchemaVisitor by @aihuaxu in (#14261)
  • Fix UUID ClassCastException when reading Parquet files with UUIDs by @ndrluis in (#14027)
• Flink
  • Ensure DynamicCommitter idempotence in the presence of failures by @mxm in (#14182)
  • Backport Ensure DynamicCommitter idempotence in the presence of failures by @mxm in (#14213)
  • Prevent recreation of ManifestOutputFileFactory during flushing by @mxm in (#14358)
  • Backport Prevent recreation of ManifestOutputFileFactory during flushing by @mxm in (#14385)
  • Fix cache refreshing in DynamicIcebergSink by @aiborodin in (#14406)
  • Port fix cache refreshing in DynamicIcebergSink by @aiborodin in (#14765)
• Spark
  • 3.4: Pass format-version when creating a snapshot by @Fokko in (#14170)
  • 3.5: Pass format-version when creating a snapshot by @Fokko in (#14169)
  • 4.0: Pass format-version when creating a snapshot in table migration actions by @Fokko in (#14163)
  • Fix Z-order UDF to correctly handle DateType by @ronkapoor86 in (#14108)
• Kafka Connect
  • Merge control topic and last persisted offsets by @danielcweeks in (#14525)
• Vendor integrations
  • AWS: Configure builder for reuse of HTTP connection pool in SDK v2 by @anuragmantri in (#14161)
  • AWS: Fix leaked credentials when contacting multiple catalogs by @adutra in (#14178)
  • AWS: Exclude logging dependencies from the bundle by @danielcweeks in (#14225)

Full Changelog: apache-iceberg-1.10.0...apache-iceberg-1.10.1