apache/iceberg apache-iceberg-1.10.0 on GitHub

What's Changed

Add format/ to site-ci by @Fokko in #12869
update links to daft docs by @ccmao1130 in #12860
Spark3.4: BackPort Add Parallelism Parameter Validation to AddFilesProcedure. by @slfan1989 in #12872
Core: Add test when listing namespaces with a non-existing namespace by @nastra in #12873
Flink: Add support for Flink 2.0 by @mxm in #12527
Core: Fix Kryo ser/de with StorageCredential config by @nastra in #12882
Add timestamp_ns, time and UUID types for Variant by @aihuaxu in #12682
Spec: Avoid struct field conflicts in default values by @rdblue in #12841
Core: Ensure reactivated view version uses correct timestamp by @lliangyu-lin in #12821
Parquet: Add variant array reader in Parquet by @aihuaxu in #12512
Build: Bump nessie from 0.103.3 to 0.103.5 by @dependabot[bot] in #12902
Build: Bump testcontainers from 1.20.6 to 1.21.0 by @dependabot[bot] in #12904
Build: Bump mkdocs-material from 9.6.11 to 9.6.12 by @dependabot[bot] in #12848
Build: upgrade to Gradle 8.14 by @jbonofre in #12898
Spark: Use newArrayListWithExpectedSize instead of newArrayList for NDVSketchUtil by @jackylee-ch in #12907
Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.3 to 5.4.4 by @dependabot[bot] in #12906
Docs: Release notes for 1.9.0 by @ajantha-bhat in #12911
Infra: Add 1.9.0 to issue template by @ajantha-bhat in #12913
Infra: Update doap.rdf file by @ajantha-bhat in #12918
Core: Increase wait time of flaky test by @manuzhang in #12714
Flink: Backport add StreamingStartingStrategy.INCREMENTAL_FROM_LATEST_SNAPSHOT_EXCLUSIVE to Flink 1.19 by @morhidi in #12899
Docs: Site updates for 1.9.0 by @ajantha-bhat in #12921
Spark 3.5: Update MERGE and UPDATE for row lineage by @amogh-jahagirdar in #12736
Flink: Add lockFactory open in LockRemover for table maintenance by @Guosmilesmile in #12900
Docs: Fix version doc release step by @ajantha-bhat in #12922
Parquet variant array write by @aihuaxu in #12847
Build: Bump software.amazon.awssdk:bom from 2.29.52 to 2.31.30 by @dependabot[bot] in #12905
Build: Bump jackson-bom from 2.18.3 to 2.19.0 by @dependabot[bot] in #12903
Spark 3.4: Migrate tests in sql by @tomtongue in #12934
Flink: Backport Add lockFactory open in LockRemover for table maintenance to Flink 1.20 and 1.19 by @Guosmilesmile in #12929
Docs: Add DuckDB by @szarnyasg in #12932
Spark 3.4: Migrate Spark Partition Transform tests by @tomtongue in #12941
Flink: Fix typo in JdbcLockFactory by @Guosmilesmile in #12940
Spark: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs by @pvary in #12692
Flink: Change Preconditions import from flink util to guava by @Guosmilesmile in #12939
Update Spark Parquet vectorized read tests to uses Iceberg Record instead of Avro GenericRecord by @amogh-jahagirdar in #12925
Follow up to address comments in variant array writer by @aihuaxu in #12933
OpenAPI: Use more clear language in recommending error responses by @sungwy in #12376
Core: Broaden exception handling in writer clean up logic by @xiaoxuandev in #12863
Spec: Remove misleading statement about source-ids by @wypoon in #12948
API, Build: Explicitly pass version into Git Properties Plugin by @RussellSpitzer in #12949
Build: Bump parquet from 1.15.1 to 1.15.2 by @dependabot[bot] in #12964
Build: Bump org.openapitools:openapi-generator-gradle-plugin from 7.12.0 to 7.13.0 by @dependabot[bot] in #12966
Build: Bump software.amazon.awssdk:bom from 2.31.30 to 2.31.35 by @dependabot[bot] in #12967
Build: Bump nessie from 0.103.5 to 0.103.6 by @dependabot[bot] in #12963
Spark 3.4: Migrate other sql tests by @tomtongue in #12945
Build: Bump datamodel-code-generator from 0.28.5 to 0.30.1 by @dependabot[bot] in #12961
Docs: Incorrect property in CREATE CATALOG for Flink by @mrsubhash in #12894
Spark: Add flag to handle missing files for importSparkTable by @jshmchenxi in #12212
Spec additions for encryption by @ggershinsky in #12162
Spec: Update partition stats for V3 by @aokolnychyi in #12098
AWS, GCP: Deprecate passing FileIO properties through constructor by @nastra in #12972
Flink: Maintenance - RewriteDataFiles by @pvary in #11497
Build: Bump net.snowflake:snowflake-jdbc from 3.23.2 to 3.24.0 by @dependabot[bot] in #12965
API, Core: Add deleteFile to RowDelta API by @RussellSpitzer in #12861
API, Core: Add table metadata keys for encryption by @rdblue in #12927
Enable HTTP proxy support for the client used by REST Catalog by @akhilputhiry in #12406
Flink: Backport Maintenance - RewriteDataFiles to Flink 1.19, 1.20 by @gyfora in #12991
Build: Bump Comet from 0.5.0 to 0.8.1 by @huaxingao in #12974
Core: Disallow creation of invalid PartitionSpec by @devinrsmith in #12887
REST spec: Remove update to enable row lineage by @rdblue in #12986
Spec: Update v3 summary, add row lineage by @rdblue in #12982
Docs: Mark Spark 3.3 as End-of-Life since 1.9 by @manuzhang in #12989
Spark 3.4: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs by @gaborkaszab in #12980
Build, Core: Let RevAPI compare against 1.9.0 / Fix API breakage around StorageCredential by @nastra in #12930
GCP: Support multiple storage credential prefixes by @nastra in #12881
AWS, Core, Flink, Parquet: Remove deprecations for 1.10.0 by @manuzhang in #12909
Spark 4.0 integration by @huaxingao in #12494
Spark 3.4: Migrate source and spark tests by @tomtongue in #12998
ORC: Upgrade ORC to 1.9.6 by @dongjoon-hyun in #13003
Spark 3.4: Migrate the remaining SparkCatalogTestBase related tests and remove SparkCatalogTestBase by @tomtongue in #13007
Core: Refactor and use InternalData for partition stats by @ajantha-bhat in #12946
Add databend & iceberg docuement url by @sundy-li in #13002
Revert "Spark 4.0 integration" by @huaxingao in #13006
Update ADLS implementation status by @mrcnc in #13020
Spec: Clarify behavior of special geo objects for lower/upper bounds by @szehon-ho in #12956
Spark: Migrate Spark 3.4 SparkTestBaseWithCatalog related tests including refactoring Spark 3.5 tests by @tomtongue in #13015
Spark: Migrate Spark 3.4 SparkTestBase related tests including refactoring Spark 3.5 tests by @tomtongue in #13031
Docs: Add Spark SQL Configurations by @guykhazma in #12931
Parquet: Fix to ensure that last updated sequence numbers for V2 and earlier tables are null by @amogh-jahagirdar in #13001
Build: Bump mkdocs-material from 9.6.12 to 9.6.13 by @dependabot[bot] in #13029
REST spec: Add encryption keys by @rdblue in #12987
Add table property to disable/enable parquet column statistics #12770 by @huaxiangsun in #12771
Docs: Fix links to javadoc by @manuzhang in #12880
OpenAPI: Add retries when finding free port for REST server by @manuzhang in #13017
Spark 3.4: Migrate tests in spark.data including refactoring Spark 3.5 tests by @tomtongue in #13038
Catalog: Add BigQuery Metastore Catalog Support by @talatuyarer in #12808
Spark 3.4: Migrate tests in spark.source including refactoring Spark 3.5 tests by @tomtongue in #13040
Spec: Note position delete files are only deprecated in v3 by @manuzhang in #12983
Nessie: Throw a NoSuchNamespaceException when listing a non-existing namespace by @coderfender in #12901
Docs: Add Delete Granularity option to write configuration by @tomtongue in #13046
Spark 3.4: Migrate other JUnit 4 dependant tests to JUnit 5 by @tomtongue in #13044
Arrow: Avoid deprecated ArrowType.Decimal constructor by @ebyhr in #13051
Core: Support incremental compute for partition stats by @ajantha-bhat in #12629
Build: Bump com.google.cloud:libraries-bom from 26.59.0 to 26.60.0 by @dependabot[bot] in #13026
Build: Bump io.netty:netty-buffer from 4.2.0.Final to 4.2.1.Final by @dependabot[bot] in #13028
Flink: Add DynamicRecord / DynamicRecordInternal / DynamicRecordInternalSerializer by @mxm in #12996
Common: Reduce visibility of deprecated method since 1.7.0 by @ajantha-bhat in #13053
Spark4.0 rc6 integration with Iceberg by @huaxingao in #13059
Build: Remove JUnit4 dependency by @nastra in #12938
Flink: Support zookeeper lock in TableMaintenance by @Guosmilesmile in #12810
[SPARK] Fix add_files type conversion exception and incorrect partition value when handling null partitions by @hariuserx in #12886
CatalogTests: Fixing Table Location with baseTableLocation function by @talatuyarer in #13071
Flink: Backport support zookeeper lock in TableMaintenance to Flink 1.19 and 2.0 by @Guosmilesmile in #13063
Kafka Connect: Add BigQuery Metastore catalog by @juldrixx in #13041
Flink: Fix watermark not passing in TaskResultAggregator by @Guosmilesmile in #13069
[Core] Add max files rewrite option for RewriteAction by @coderfender in #12824
Build: Bump mkdocs-material from 9.6.13 to 9.6.14 by @dependabot[bot] in #13090
Spec: Clarify writer requirements to prevent orphan DVs by @aokolnychyi in #13042
API, Tests: Reorder as calls by @RussellSpitzer in #13083
Build: Bump software.amazon.awssdk:bom from 2.31.35 to 2.31.45 by @dependabot[bot] in #13088
Build: Bump nessie from 0.103.6 to 0.104.1 by @dependabot[bot] in #13025
Flink:Backport fix watermark no pass in TaskResultAggregator to Flink 1.19 and 1.20 by @Guosmilesmile in #13085
Core: Deep copy Record values for equality deletes by @hsingh574 in #12855
Spark 4.0: Reapply changes removed during the Spark 4.0 reversion by @tomtongue in #13096
add_docs_and_backport_max_files_rewrite_option by @coderfender in #13082
Spark 3.5: Structured Streaming read limit support follow-up by @wypoon in #12260
Parquet: Fix redundant type conversion in parquet schema by @lliangyu-lin in #13114
Spark 3.4: Structured Streaming read limit support follow-up by @wypoon in #13099
Build: increase gradle jvm heap size from 1 GB to 1.5 GB. by @stevenzwu in #13110
Spark 4.0: Structured Streaming read limit support follow-up by @wypoon in #13095
CORE: [PARQUET] Log corrupted parquet filenames to trace bad nodes that may have written them. by @dhruv-pratap in #13108
AWS: Support multiple storage credential prefixes by @nastra in #12799
Spec: Add details on GZIP compressed metadata files by @emkornfield in #12598
Flink: Remove the MiniClusterWithClientResource dependency by @JeonDaehong in #13021
Docs: Update spec version for write modes by @ajantha-bhat in #13138
AWS: Skip cleanup of analytics accelerator when disabled by @devinrsmith in #13134
Flink: Fix npe in TaskResultAggregator when job recovery by @Guosmilesmile in #13086
Spark4.0: RC -> official release by @huaxingao in #13121
Flink: Backport fix npe in TaskResultAggregator when job recovery to Flink 1.19 and 1.20 by @Guosmilesmile in #13140
AWS: Close the S3SeekableInputStreamFactory before removing from cache by @SanjayMarreddi in #12891
Docs: add Tinybird to the list of vendors and blog posts by @futurepastori in #13128
Build: Upgrade to Gradle 8.14.1 by @jbonofre in #13149
Build: Bump com.palantir.gradle.gitversion:gradle-git-version from 3.2.0 to 3.3.0 by @dependabot[bot] in #13144
Build: Bump software.amazon.awssdk:bom from 2.31.45 to 2.31.50 by @dependabot[bot] in #13148
Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.4 to 5.5 by @dependabot[bot] in #13147
Build: Bump com.google.cloud:libraries-bom from 26.60.0 to 26.61.0 by @dependabot[bot] in #13146
Core, AWS, Spark: use loopback address explicitly in tests to work in more restrictive firewall env on dev machines by @stevenzwu in #13101
REST Spec: Add row lineage fields by @singhpk234 in #13010
Flink 1.19, 1.20: Remove the MiniClusterWithClientResource dependency by @JeonDaehong in #13165
Docs, Flink: Fix equality fields requirement in upsert mode by @manuzhang in #13127
Spark 3.4: streaming-skip-overwrite-snapshots fix by @wypoon in #13168
Infra: Set 1.9.1 to Latest Release by @RussellSpitzer in #13177
Site: Updates for 1.9.1 Release by @RussellSpitzer in #13176
Core: Fix incremental compute of partition stats for various edge cases by @ajantha-bhat in #13163
Core: Avoid table corruption from 409 on self conflicts after 5xx retries by throwing CommitStateUnknown by @singhpk234 in #12818
Spec: Mark version 3 as completed by @ajantha-bhat in #13175
Build: Bump kafka from 3.9.0 to 3.9.1 by @dependabot[bot] in #13145
Add Variant toString for time/nano-timestamps type by @aihuaxu in #13151
AWS: Configure Default s3Async credentials the same as s3 by @devinrsmith in #13132
Make PartitionSpec.Builder::identity public by @sfc-gh-bhannel in #12975
Spark 3.5: Update to Spark 3.5.6 by @drexler-sky in #13142
Spark: clean up obsoleted/unused writer classes by @stevenzwu in #13193
chore: Update status.md by @zeroshade in #13182
Docs: Reorganize Spark Time Travel Doc by @Bhargavkonidena in #13113
AWS: update test cases to verify credentials for the prefixed S3 client by @plusplusjiajia in #13118
API, Core: Rename RowDelta deleteFile to removeRows by @RussellSpitzer in #13184
Build: Bump testcontainers from 1.21.0 to 1.21.1 by @dependabot[bot] in #13199
Build: Bump guava from 33.4.7-jre to 33.4.8-jre by @dependabot[bot] in #12851
Build: Bump com.google.errorprone:error_prone_annotations from 2.37.0 to 2.38.0 by @dependabot[bot] in #12852
Build, Core: Move assertions to AssertJ / Fix checkstyle rules by @singhpk234 in #13213
Core: Catch IAE when decoding JWT by @nika-qubit in #13192
Hive: Throw exception for when listing a non-existing namespace by @jmelinav in #13130
Docs: add column descriptions for entries metadata table by @elphastori in #13104
Reduce code duplication in VectorizedParquetDefinitionLevelReader by @wypoon in #11661
Docs: Add custom table location description for Flink by @tomtongue in #13214
SPARK: Remove dependency on hadoop's filesystem class from remove orphan files by @liziyan-lzy in #12254
Core: Improve pagination logic to handle null pageToken by @elphastori in #13129
Build: Bump org.apache.hadoop.thirdparty:hadoop-shaded-guava from 1.3.0 to 1.4.0 by @dependabot[bot] in #12684
Flink: port range distribution to v2 iceberg sink by @rodmeneses in #12071
Flink: Dynamic Iceberg Sink: Add table update code for schema comparison and evolution by @mxm in #13032
Core: Add basic classes for writing table format-version 4 by @nastra in #13123
Spark: Fix flaky testParallelPartialProgressWithMaxFailedCommitsLargerThanTotalFileGroup by @manuzhang in #13208
Flink: Backport IcerbegSink RANGE distribution to Flink 1.19 and 2.0 by @rodmeneses in #13228
Flink: Dynamic Iceberg Sink: Add dynamic writer and committer by @mxm in #13080
[REST] Add option to configure TLS settings in REST client by @bryanck in #13190
Docs: Document DataFrame API support for MERGE INTO in Spark 4.0 by @wypoon in #13231
Docs: Add Redpanda to vendor-related documentation by @lf-rep in #13242
Flink: Support compact in iceberg sink v2 by @Guosmilesmile in #12979
Flink: Backport #12996 to Flink 1.19 / 1.20 by @mxm in #13246
Flink: Backport #13032 to Flink 1.19 / 1.20 by @mxm in #13247
Flink: Backport #13080 to Flink 1.19 / 1.20 by @mxm in #13248
AWS, GCS: Fix issue with Kryo and empty immutable collections by @nastra in #13216
Spark 3.5, Arrow: Support for Row lineage when using the Parquet Vectorized reader by @amogh-jahagirdar in #12928
Spark 4.0: Add a test for DataFrame API support for MERGE INTO by @wypoon in #13230
Flink: Backport support compaction in sink v2 to 1.19 and 2.0 by @Guosmilesmile in #13250
API, AWS, Azure, Core, GCP: Use parametrized tests for Kryo/Java serialization verification by @nandorKollar in #13244
Docs: Remove obsolete version attribute in quick start docker-compose.yml by @omkenge in #13139
Docs: use latest minio client command configuration parameters by @jerry153fish in #13221
Build: Upgrade to Gradle 8.14.2 by @jbonofre in #13259
Build: Bump openapi-spec-validator from 0.7.1 to 0.7.2 by @dependabot[bot] in #13275
Build: Bump datamodel-code-generator from 0.30.1 to 0.30.2 by @dependabot[bot] in #13274
Backport ThreadPools introduce newExitingWorkerPool and newFixedThreadPool to Flink 1.19 and Spark 3.4 by @Guosmilesmile in #13265
SPARK: Port prefix listing option in remove orphan files to Spark 3.4 and Spark 4.0 by @liziyan-lzy in #13264
Flink: Dynamic Iceberg Sink: Add HashKeyGenerator / RowDataEvolver / TableUpdateOperator by @mxm in #13277
Docs: Fix engine-version key in the JSON example by @hsiang-c in #13292
Build: Bump io.netty:netty-buffer from 4.2.1.Final to 4.2.2.Final by @dependabot[bot] in #13273
Flink: Backport #13277 to Flink 1.19 / 1.20 by @mxm in #13303
Docs: Fix list rendering and typos (#13075) by @yelianevich in #13267
Docs: Fix broken links in Flink Configuration documentation by @KyleLin0927 in #13288
Spark: RewriteTablePath: filter content files by snapshotId by @dramaticlly in #12885
REST: Add property for configuring user agent in http client by @singhpk234 in #13234
Build: Bump software.amazon.awssdk:bom from 2.31.50 to 2.31.63 by @dependabot[bot] in #13316
Build: Bump datamodel-code-generator from 0.30.2 to 0.31.0 by @dependabot[bot] in #13319
Build: Bump org.xerial:sqlite-jdbc from 3.49.1.0 to 3.50.1.0 by @dependabot[bot] in #13318
Build: Bump jackson-bom from 2.19.0 to 2.19.1 by @dependabot[bot] in #13315
Build: Bump io.delta:delta-spark_2.12 from 3.3.1 to 3.3.2 by @dependabot[bot] in #13205
Build: Bump com.google.cloud:libraries-bom from 26.61.0 to 26.62.0 by @dependabot[bot] in #13317
Build: Bump io.delta:delta-standalone_2.12 from 3.3.1 to 3.3.2 by @dependabot[bot] in #13202
Build: Bump net.snowflake:snowflake-jdbc from 3.24.0 to 3.24.2 by @dependabot[bot] in #13200
Flink: If IcebergSink writeParallelism is not specified, defaults to the input source parallelism by @rodmeneses in #13260
docs: Fix typo in rewrite_manifests output table in spark-procedures.md by @zschumacher in #13325
Flink: Backports #13260 to Flink 1.19 and 1.20 by @rodmeneses in #13326
Flink: Dynamic Iceberg Sink: Add sink / core processing logic / benchmarking by @mxm in #13304
AWS, GCP: Fix double-checked-locking pattern in S3FileIO, GCSFileIO. by @ChaladiMohanVamsi in #13276
[CORE][REST]: Add context aware response parsing by @singhpk234 in #13191
Flink: Backport #13304 to Flink 1.19 / 1.20 by @mxm in #13341
Flink: Dynamic Iceberg Sink: Rename method in DynamicRecordGenerator by @mxm in #13342
Core: PartitionsTable#partitions returns incomplete list in case of partition evolution and NULL partition values by @deniskuzZ in #12528
Flink: Backport #13342 to Flink 1.19 / 1.20 by @mxm in #13346
Core: Clean expired metadata even if there is no snapshot to expire by @lirui-apache in #13322
Docs: Add Firebolt to list of vendors and blog posts by @jingtao-firebolt in #13350
Spark 3.4: Backport #12836 for row lineage support in spark parquet reader by @geruh in #13353
GCP: Add Google Authentication Support by @talatuyarer in #13212
spark 4.0: SPJ: add bucket reducer using gcd by @himadripal in #13167
Spark 3.4: Backport UPDATE/MERGE logic for row lineage by @geruh in #13344
Bump AzuriteContainer to 3.34.0 by @Fokko in #13321
Docs: Fix description of min-input-files option of Spark rewrite_data_files procedure by @manuzhang in #13355
Build: Bump datamodel-code-generator from 0.31.0 to 0.31.1 by @dependabot[bot] in #13362
Build: Bump testcontainers from 1.21.1 to 1.21.2 by @dependabot[bot] in #13363
Flink: Revise the display of the task name in TableMaintenance to show the specific task name. by @Guosmilesmile in #13024
Flink:Backport Revise the display of the task name in TableMaintenance to show the specific task name by @Guosmilesmile in #13372
Spark-3.5, 4.0: Add unit tests for ColumnarBatchUtil by @anuragmantri in #12275
Core: Fix filed ids of partition stats file by @ajantha-bhat in #13329
Flink: Migrate Flink TableSchema to Schema/ResolvedSchema by @liamzwbao in #13072
Remove JSpecify annotations from bundled-guava by @electrum in #13379
Build: Use Java 17 to publish snapshot to Maven by @pan3793 in #13369
Build: Require JDK 17 / 21 for Spark 4.0 support by @zhztheplayer in #13381
Build: Bump calcite from 1.39.0 to 1.40.0 by @dependabot[bot] in #13203
Build: Run CI actions with JDK 17 by @nastra in #13385
Core: Fix API breakage introduced by #13191 by @nastra in #13386
Further refactor Parquet readers for v2 support by @eric-maynard in #13290
Core, REST: properly close resources when catalog initialization fails by @adutra in #13384
Flink: Backports TableSchema migration to Flink 1.19 and 1.20 by @liamzwbao in #13392
Flink: Dynamic Iceberg Sink: Optimise RowData evolution by @aiborodin in #13340
Build: Fix errorprone warnings by @CuteChuanChuan in #13217
Spark: Fix row lineage inheritance for distributed planning by @amogh-jahagirdar in #13061
Flink: Backport optimised RowData evolution to Flink 1.19 / 1.20 by @aiborodin in #13401
Docs: improve structure for manifest entry fields by @elphastori in #13333
Spark: Make maxRecordPerMicrobatch a soft limit by @singhpk234 in #12988
ICEBERG-13343: fix race condition in JdbcCatalog by @Claudenw in #13345
Build: Bump com.google.errorprone:error_prone_annotations from 2.38.0 to 2.39.0 by @dependabot[bot] in #13423
Build: Bump com.palantir.gradle.gitversion:gradle-git-version from 3.3.0 to 3.4.0 by @dependabot[bot] in #13422
Build: Bump testcontainers from 1.21.2 to 1.21.3 by @dependabot[bot] in #13416
Build: Bump datamodel-code-generator from 0.31.1 to 0.31.2 by @dependabot[bot] in #13413
Build: Bump org.openapitools:openapi-generator-gradle-plugin from 7.13.0 to 7.14.0 by @dependabot[bot] in #13421
Build: Bump org.immutables:value from 2.10.1 to 2.11.0 by @dependabot[bot] in #13420
Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.6 to 8.3.7 by @dependabot[bot] in #13414
Docs: Correct typo in spec.md by @CuteChuanChuan in #13427
AWS: Refactor S3FileIOProperties to use common builder interface by @devinrsmith in #13183
Build: Bump com.azure:azure-sdk-bom from 1.2.31 to 1.2.35 by @dependabot[bot] in #13201
spark 4.0 : SPJ : add hour to day reducer by @himadripal in #13166
Spark 3.4: Backport #13061 fix for row lineage inheritance in distributed planning by @amogh-jahagirdar in #13436
GCS: Add Iceberg version to UserAgent in GCS requests by @shubham-diwakar in #13428
[iceberg-rest-fixture] fix sqlite error under high concurrent load by @kevinjqliu in #13367
Flink 2.0: Replace Caffeine maxSize cache with LRUCache by @aiborodin in #13382
Spark, Avro: Add support for row lineage in Avro reader by @amogh-jahagirdar in #13070
Core: Maintain passed in ordering of files in Manifest Lists by @RussellSpitzer in #13411
REST: Revert #12818 and additionally stop retrying on 502/504 by @singhpk234 in #13352
Spark 3.4: Backport tests from #13070 to 3.4 by @amogh-jahagirdar in #13440
CheeryPick 12988 to all Spark version by @singhpk234 in #13412
Spark 3.5, 4.0: Prevent unnecessary failure when executing DML queries with identifier fields by @szehon-ho in #13435
Flink: Backport LRUCache usage to Flink 1.19/1.20 by @aiborodin in #13441
Arrow, AWS, Azure, Core, GCP, Hive, Kafka, Snowflake: Rename test classes to use Test as prefix instead of suffix by @nastra in #12879
Ignore partition fields that are dropped from the current-schema by @Fokko in #11868
Build: Bump software.amazon.awssdk:bom from 2.31.63 to 2.31.73 by @dependabot[bot] in #13424
Build: Fix error-prone warning by @CuteChuanChuan in #13447
Spark 3.4: Prevent unnecessary failure when executing DML queries with identifier fields by @szehon-ho in #13448
Core, Spark: Propagate orphaned delete files when rewriting data files by @nastra in #13245
Docs: Describe testcontainer failure workaround by @Claudenw in #13454
Spark-3.5: Add spark action to compute partition stats by @ajantha-bhat in #12450
site: update daft docs by @ccmao1130 in #13463
S3: Add LegacyMd5Plugin to S3 client builder by @ebyhr in #12264
Build: Upgrade to Gradle 8.14.3 by @jbonofre in #13465
docs: Mark Rust ADLS FileIO as implemented in the status page by @DerGut in #13258
Spark-4.0: Add spark action to compute partition stats by @ajantha-bhat in #13478
Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.7 to 8.3.8 by @dependabot[bot] in #13476
Build: Bump software.amazon.awssdk:bom from 2.31.73 to 2.31.77 by @dependabot[bot] in #13475
Build: Bump org.xerial:sqlite-jdbc from 3.50.1.0 to 3.50.2.0 by @dependabot[bot] in #13468
Build: Bump com.azure:azure-sdk-bom from 1.2.35 to 1.2.36 by @dependabot[bot] in #13474
Core: Support DV for partition stats by @ajantha-bhat in #13425
Spark: Throw unsupported for ADD COLUMN with default value by @amogh-jahagirdar in #13464
Spark 4.0: Migrate Iceberg Stored Procedures to Spark built-in implementations by @pan3793 in #13106
Core: Keep track of data files to be removed for orphaned DV detection by @nastra in #13222
Add BigQuery Dependencies for Iceberg GCP Bundle by @talatuyarer in #13111
Spec: Add DV information in overview by @ajantha-bhat in #13189
AWS: Prevent excessive creation of auth sessions in S3V4RestSignerClient by @adutra in #13215
Spark 4.0: Port Avro lineage reader test changes from #13070 by @amogh-jahagirdar in #13496
Build: Bump nessie to 0.104.2 skipping tests in JDK 11 by @manuzhang in #13490
Spark: Use native table FileIO instead of Hadoop to save file list in RewriteTablePath by @NikitaMatskevich in #13459
API, Flink: fix typos in javadoc by @laurentgo in #13503
Spark: Support Parquet dictionary encoded UUIDs by @Fokko in #13324
Docs: Add Ryft to list of vendors and blog posts by @yogevyuval in #13504
Spark-3.5: Add procedure to compute partition stats by @ajantha-bhat in #13480
Core: Fix a cast that is too narrow by @angelo-DNAStack in #12743
Build: Bump JUnit5 from 5.12.2 to 5.13.2 by @raveendra11 in #13280
Spark 4.0: Add procedure to compute partition stats by @ajantha-bhat in #13523
Make metrics reporting asynchronous by @anoopj in #13507
API, Spark 4.0: Expose cleanExpiredMetadata in expire_snapshots Spark procedure by @gaborkaszab in #13509
Core: Implement close() method in CompositeMetricsReporter by @anoopj in #13535
Fix Spark DDL Doc bug by @davidyuan1223 in #13539
Build: Bump nessie from 0.104.2 to 0.104.3 by @dependabot[bot] in #13541
Build: Bump com.google.errorprone:error_prone_annotations from 2.39.0 to 2.40.0 by @dependabot[bot] in #13542
Build: Bump software.amazon.awssdk:bom from 2.31.77 to 2.31.78 by @dependabot[bot] in #13543
Build: Bump com.gorylenko.gradle-git-properties:gradle-git-properties from 2.5.0 to 2.5.2 by @dependabot[bot] in #13544
Docs: Document clean_expired_metadata parameter in expire_snapshots Spark procedure by @gaborkaszab in #13516
Spark 3.4, 3.5: Expose cleanExpiredMetadata in expire_snapshots Spark procedure by @gaborkaszab in #13553
Spark 4.0: Row Lineage support by @amogh-jahagirdar in #13310
Docs: Add BladePipe to list of vendors and blog posts by @ChocZoe in #13510
Enforce that test classes start with "Test" instead of suffix by @CuteChuanChuan in #13466
[docs] Add two Iceberg blogs by @rmoff in #13493
Docs: Hardcode BSD sed if running on MacOS (Closes #13499) by @rmoff in #13501
[docs] Remove Tabular from Vendors page by @rmoff in #13511
fix a typo in TestDataFileIndexStatsFilters by @hussein-awala in #13540
[docs] Add Confluent to vendors page by @rmoff in #13512
Core: Add Schema evolution test with initial defaults by @anoopj in #13537
Site: Updates for 1.9.2 Release by @singhpk234 in #13578
Spark 4: Support Parquet dictionary encoded UUIDs by @Fokko in #13573
INFRA: Add 1.9.2 to latest by @singhpk234 in #13577
Core: Add Schema evolution test with partition transform on a field with default values by @anoopj in #13570
Docs: Fix indentation of 1.9.2 release note by @ebyhr in #13583
kafka-connect: resolve CVE-2025-48734 by @liko9 in #13561
Docs: Document compute_partition_stats procedure by @ajantha-bhat in #13532
API, Core: Avoid boxing of integer in evaluators / simplify ManifestReader by @nastra in #13589
Docs: Fix the default value of use_caching to false in the rewrite_manifests and add where parameter to rewrite_position_delete_files by @tomtongue in #13549
Core: Add 'google' auth type to auth manager by @ebyhr in #13564
Docs: Add creating release from passed RC tag by @singhpk234 in #13595
[docs] Tidy up left-hand navigation by @rmoff in #13491
AWS: KeyManagementClient implementation that works with AWS KMS by @szlta in #13136
Build: Bump io.netty:netty-buffer from 4.2.2.Final to 4.2.3.Final by @dependabot[bot] in #13605
Build: Bump org.immutables:value from 2.11.0 to 2.11.1 by @dependabot[bot] in #13603
Build: Bump org.xerial.snappy:snappy-java from 1.1.10.7 to 1.1.10.8 by @dependabot[bot] in #13601
Spark: Fix flaky testParallelPartialProgressWithMaxFailedCommitsLargerThanTotalFileGroup by @manuzhang in #13598
Use short string in Variant when possible by @manirajv06 in #13284
Spark 4.0: Rename SparkCatalogConfig#SPARK to SparkCatalogConfig#SPARK_SESSION by @manuzhang in #13607
Spark: Unimplement WithAssertions from test class by @nastra in #13610
Docs: Fix spelling errors in Iceberg v3 spec.md. by @slfan1989 in #13622
Spec: Add manifests fields to Snapshot Summary metrics by @manuzhang in #13238
Core: make SnapshotRefType public by @nryanov in #13621
Spark: use Bulk deletion for manifests when import files to an iceberg table by @dramaticlly in #13620
Spark 4.0: Preserve row lineage information on compaction by @amogh-jahagirdar in #13555
Test: Simplify collection and optional assertions by @ebyhr in #13613
Bump com.google.cloud:libraries-bom from 26.62.0 to 26.64.0 by @liamzwbao in #13632
Build, Flink: Add timeout and print more logs by @pvary in #13627
Core: Implement Map comparator by @pvary in #13626
Flink: Dynamic Sink: Ensure parent for newly added struct is resolved from current schema by @mxm in #13639
Spark 3.5: Backport #13555 for preserving row lineage on compaction by @amogh-jahagirdar in #13637
Build: Bump jackson-bom from 2.19.1 to 2.19.2 by @dependabot[bot] in #13600
Spark 3.4: Backport #13555 for preserving row lineage on compaction by @amogh-jahagirdar in #13641
Flink: fail file rewrite for V3 tables as row lineage not supported by @stevenzwu in #13646
spark 4: add tests to verify Arrow Support for Row lineage when using the Parquet Vectorized reader by @kevinjqliu in #13649
spark 4: add test to verify ignore partition fields that are dropped from the current-schema by @kevinjqliu in #13648
Spark 3.5: backport rename SparkCatalogConfig#SPARK to SparkCatalogConfig#SPARK_SESSION by @kevinjqliu in #13650
Docs: Move links to other implementations out of Java docs by @manuzhang in #13618
Azure: Add extra error logging in ADLSFileIO by @NikitaMatskevich in #13517
Flink: backport PR #13646 for fail compaction on V3 tables by @stevenzwu in #13652
Core: backport PR #13100 from 1.9 to main branch that partially revert 12670 by sending single snapshot rather than in bulk by @stevenzwu in #13647
Flink: Clean up UpdateSchema instantiator method by @mxm in #13640
Flink: Adds support for SpeculativeExecution for IcebergSink by @rodmeneses in #13642
Flink: Adjust the configuration precedence for the dynamic sink by @Guosmilesmile in #13609
Backport #13639: Flink: Dynamic Sink: Ensure parent for newly added struct is resolved from current schema by @mxm in #13656
Flink: DynamicSink: Convert existing required fields to optional by @mxm in #13659
Backport #13640: Flink: Clean up UpdateSchema instantiator method in TestEvolveSchemaVisitor by @mxm in #13658
Build: Statically import Assumptions.assumeThat() by @nastra in #13655
Backport: Flink: DynamicSink: Convert existing required fields to optional by @mxm in #13660
Flink: Backport: Adds support for SpeculativeExecution for IcebergSink by @rodmeneses in #13663
REST-Fixture: Ensure strict mode on jdbc catalog for rest fixture by @jayceslesar in #13599
docs: add subpage for REST Catalog Spec in "Specification" by @kevinjqliu in #13521
[Core] Use Bulk deletion for cleaning up uncommitted files in BaseTransaction by @dramaticlly in #13653
Core: Use zero-copy wrapper for equalityFieldIds by @bvolpato in #13668
Improve test coverage for 1-5 byte header string primitive in Variant by @manirajv06 in #13629
Core: Prevent empty Puffin file creation in DV writer by @geruh in #13666
Core: Allow retries for Idempotent Requests with Certain Codes by @RussellSpitzer in #13449
Build: Bump datamodel-code-generator from 0.31.2 to 0.32.0 by @dependabot[bot] in #13688
Build: Bump mkdocs-material from 9.6.14 to 9.6.16 by @dependabot[bot] in #13689
Build: Bump junit from 5.13.2 to 5.13.4 by @dependabot[bot] in #13684
Build: Bump com.google.errorprone:error_prone_annotations from 2.40.0 to 2.41.0 by @dependabot[bot] in #13683
Build: Bump org.xerial:sqlite-jdbc from 3.50.2.0 to 3.50.3.0 by @dependabot[bot] in #13686
Build: Bump software.amazon.awssdk:bom from 2.31.78 to 2.32.9 by @dependabot[bot] in #13687
Build: Bump junit-platform from 1.13.2 to 1.13.4 by @dependabot[bot] in #13682
Core, Data: Cleanup unit tests by delegating file cleanup to JUnit by @anoopj in #13590
Core: Fix incorrect selection of incremental cleanup in expire snapshots by @amogh-jahagirdar in #13614
Spark: Add Variant read support for Spark Iceberg tables by @aihuaxu in #13219
Flink:RewriteDataFiles support filter in plan by @Guosmilesmile in #13669
Flink: Add test for adjust the configuration precedence in the dynamic sink by @Guosmilesmile in #13662
Minor: Use hasSameSizeAs to show more debug info by @aihuaxu in #13701
Build: Bump orc from 1.9.6 to 1.9.7 by @dependabot[bot] in #13470
Add support for DELTA_BINARY_PACKED Parquet encoding by @eric-maynard in #13391
Flink: Add doc for the dynamic sink by @Guosmilesmile in #13608
Flink:Backport RewriteDataFiles support filter in plan to Flink 1.19 and 1.20 by @Guosmilesmile in #13702
Flink: disable flaky testRangeDistributionStatisticsMigration() by @stevenzwu in #13711
[Spec]: Fix wrong type for snapshot-id in table statistics by @Smith-Cruise in #13513
Use decimal precision to determine variant decimal type by @aihuaxu in #13692
Core: Fix case-insensitive validation of fields in schema evolution by @riemenschneider in #13697
Core: refactor BaseTransaction for extensibility by @dramaticlly in #13631
Arrow: test case for fixed type by @nandorKollar in #13700
Core: introduce shared authentication refresh executor by @adutra in #12563
fix: coerce UUID to String in readable_metrics to avoid ClassCastException in Spark by @kadai0308 in #13087
Flink 2.0: Expose cleanExpiredMetadata for snapshot expiration by @gaborkaszab in #13569
Build: Bump software.amazon.awssdk:bom from 2.32.9 to 2.32.14 by @dependabot[bot] in #13721
Build: Bump com.google.cloud:libraries-bom from 26.64.0 to 26.65.0 by @dependabot[bot] in #13722
Flink 1.19, 1.20: Expose cleanExpiredMetadata for snapshot expiration by @gaborkaszab in #13729
Flink: Re-enable test range distribution statistics migration by @stevenzwu in #13725
Build: Bump net.snowflake:snowflake-jdbc from 3.24.2 to 3.25.1 by @dependabot[bot] in #13685
Core: make BaseRowDelta public by @dramaticlly in #13643
Add Databricks to vendors.md by @lisancao in #13734
API, Core: Preserve original Type for upper/lower bounds in Metrics by @nastra in #13695
Spark: Print unknown catalog type in exception when configureValidationCatalog by @manuzhang in #13588
Spark: Use default cleanExpiredMetadata from Java API by @gaborkaszab in #13731
Build: Bump org.apache.commons:commons-compress from 1.27.1 to 1.28.0 by @dependabot[bot] in #13723
AWS: Fix OAuth2 additional params inclusion by @adutra in #13718
Flink: Fix DynamicCommitter use ThreadPools deprecated method by @Guosmilesmile in #13728
Close resources only if initialised to avoid rare case NPE by @kumarpritam863 in #13670
Core, Spark: Preserve the relative path in RewriteTablePathUtil on staging by @Elbehery in #13645
Spark: Use ORC batch for orcBatchReadConf() by @hsiang-c in #13748
Build: Bump com.azure:azure-sdk-bom from 1.2.36 to 1.2.37 by @suhwan-cheon in #13743
Docs: Flink can add/drop/modify columns by @rmoff in #13617
Fix concurrency issues in Azure credential refresh. by @msawyer-palantir in #13730
Revert "Coerce UUID to String in readable-metrics (#13087)" by @Fokko in #13754
API: Fix timestamp(9) with identity partitioning. by @rdblue in #13746
API: Add expression factory methods for timestamp literals. by @rdblue in #13747
AWS, Aliyun: Fix memory leak by removing deleteOnExit() calls by @kamijin-fanta in #13749
Docs: Add V3 types to Spark/Flink type conversion table by @manuzhang in #13744
Core: Remove redundant V2TableTestBase by @ebyhr in #13757
Introduce MetricsMaxInferredColumnDefaultsStrategy by @jkolash in #13039
Core: Use ResourcePaths instead of hard-coded resource paths by @nastra in #13759
Core: support timestamp nanos in single value parser by @ebyhr in #13487
Docs: Update the Kafka Connect readme by @mimaison in #13484
OpenAPI: Correct type annotation in TableMetadat#encryption-keys field by @blakesmith in #13762
Kafka Connect: Add manifests for the transformations by @mimaison in #13531
Core: Deprecate unused methods in OAuth2Util by @nastra in #13767
Docs: Meetup Guidelines by @danicafine in #13520
core: remove duplicate lines in ExponentialHttpRequestRetryStrategy by @huaxingao in #13770
Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.8 to 8.3.9 by @dependabot[bot] in #13776
Build: Bump org.immutables:value from 2.11.1 to 2.11.2 by @dependabot[bot] in #13779
Build: Bump software.amazon.awssdk:bom from 2.32.14 to 2.32.19 by @dependabot[bot] in #13778
Build: Bump org.assertj:assertj-core from 3.27.3 to 3.27.4 by @dependabot[bot] in #13777
Spark,Core: Refactor Delete OrphanFiles by moving common code from Spark to core by @Guosmilesmile in #13429
Spark: Remove unused code by @nastra in #13790
Spark: Backport #13429 to Spark 4.0 and 3.4 by @Guosmilesmile in #13789
Parquet: Fix incorrect JavaDoc parameter descriptions in TripleWriter by @sokojh in #13784
site: reorganize navbar so that "community" is top level by @kevinjqliu in #13774
Add golden file tests for vectorized Parquet reads by @eric-maynard in #13450
Spark: Remove unused parameter in RewriteTablePathSparkAction#rewritePositionDeletes by @manuzhang in #13792
Core: Batch load new files when validating replaced partitions by @gabeiglio in #13556
nit: Make style consistent by @Fokko in #13794
Replace assertThrows with assertThatThrownBy for better readability. by @slfan1989 in #13772
Docs: Fix community links in footer by @manuzhang in #13796
docs: reorder so "Apache Iceberg Community Calendar" is first by @kevinjqliu in #13806
Spark 4.0: Add configuration to disable executor cache for delete files by @anuragmantri in #12893
Docs: fix typo in JdbcLockFactory Javadoc by @slfan1989 in #13811
Spark: Prune dead branch by @Fokko in #13808
Spark 3.5, 3.4: Add configuration to disable executor cache for delete files by @anuragmantri in #13817
Core: Use ResourcePaths instead of hard-coded resource paths in RESTCatalogAdapter by @guixiaowen in #13815
Docs: Update testing guidelines to reflect full JUnit 5 migration and AssertJ usage. by @slfan1989 in #13822
Build: Bump software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3 from 1.0.0 to 1.2.1 by @dependabot[bot] in #13545
Docs: Minor improvements to Variant sections by @nastra in #13828
Core: Allow disabling token exchange as refresh by @danielcweeks in #13809
Spark 4.0: Disable executor cache for delete files in RewriteDataFilesSparkAction by @anuragmantri in #13820
Core: Request/Response models and parsers for REST Scan Planning by @singhpk234 in #13004
Flink: Fix hash code comparison for requesting global statistics in DataStatisticsCoordinator by @Guosmilesmile in #13827
Flink: Backport #13827 to flink 1.20 and 1.19 by @Guosmilesmile in #13830
Build: Bump mkdocs-macros-plugin from 1.3.7 to 1.3.9 by @dependabot[bot] in #13846
Build: Bump mkdocs-material from 9.6.16 to 9.6.17 by @dependabot[bot] in #13845
Flink: Fix ResultSet resource leak in JdbcLockFactory.initializeLockTables(). by @slfan1989 in #13821
Flink: Fix schedule data file size incorrect in RewriteDataFilesConfig by @Guosmilesmile in https://github.com/apache/iceberg/pull/13848
Build: Bump software.amazon.awssdk:bom from 2.32.19 to 2.32.24 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13843
Build: Bump org.immutables:value from 2.11.2 to 2.11.3 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13839
Flink: Backport Fix ResultSet resource leak in JdbcLockFactory.initializeLockTables(). by @slfan1989 in https://github.com/apache/iceberg/pull/13849
Build: Bump datamodel-code-generator from 0.32.0 to 0.33.0 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13844
Build: Bump net.snowflake:snowflake-jdbc from 3.25.1 to 3.26.0 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13842
Build: Bump com.google.cloud:libraries-bom from 26.65.0 to 26.66.0 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13841
Build: Bump io.netty:netty-buffer from 4.2.3.Final to 4.2.4.Final by @dependabot[bot] in https://github.com/apache/iceberg/pull/13840
Build: Bump jetty from 11.0.25 to 11.0.26 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13838
Spark 4.0: Add removed_delete_files_count to result of RewriteDataFilesProcedure by @manuzhang in https://github.com/apache/iceberg/pull/13657
Core: Add planWith to FindFiles to leverage ParallelIterable by @regadas in https://github.com/apache/iceberg/pull/13836
Core, Docs: Update write.metadata.metrics.max-inferred-column-defaults documentation and add benchmark by @dramaticlly in https://github.com/apache/iceberg/pull/13785
Spark 3.5, 3.4: Add removed_delete_files_count to result of RewriteDataFilesProcedure by @manuzhang in https://github.com/apache/iceberg/pull/13862
feat: make RESTCatalogServer catalog name configurable by @itamarwe in https://github.com/apache/iceberg/pull/13750
ADLSFileIO: support access token authentication via the new adls.token property by @kevinjqliu in https://github.com/apache/iceberg/pull/13825
Revert "Docker: Pin QEMU version temporarily" by @ebyhr in https://github.com/apache/iceberg/pull/13861
Flink: Fix table of contents in Flink docs by @mxm in https://github.com/apache/iceberg/pull/13864
Docs: Add removed_delete_files_count to rewrite_data_files output by @manuzhang in https://github.com/apache/iceberg/pull/13865
Rewrite the Iceberg Arrow schema translation to use the visitor pattern by @anoopj in https://github.com/apache/iceberg/pull/13699
Hive: Throw NoSuchViewException when loading an Iceberg table as a view by @gabeiglio in https://github.com/apache/iceberg/pull/13847
Core: Deprecate TableMetadataParser.read with unused file io parameter by @zhongyujiang in https://github.com/apache/iceberg/pull/13871
[docs] Add EOS note to Flink docs by @rmoff in https://github.com/apache/iceberg/pull/13875
Adding new rewrite manifest spark action to accept custom partition order by @zachdisc in https://github.com/apache/iceberg/pull/12840
Spark 3.4: Support Parquet dictionary encoded UUIDs by @Fokko in https://github.com/apache/iceberg/pull/13877
Spark 3.5, 3.4: Disable executor cache for delete files in RewriteDataFilesSparkAction by @anuragmantri in https://github.com/apache/iceberg/pull/13868
Arrow: Add nanosec precision timestamp by @nandorKollar in https://github.com/apache/iceberg/pull/13562
Flink: Supports delete orphan files in TableMaintenance by @Guosmilesmile in https://github.com/apache/iceberg/pull/13302
Flink: Move state import from v2 to v1 in SkipOnError by @Guosmilesmile in https://github.com/apache/iceberg/pull/13888
Flink: Backport supports delete orphan files in TableMaintenance to 1.19 and 1.20 by @Guosmilesmile in https://github.com/apache/iceberg/pull/13887
Flink custom source parallelism by @swapna267 in https://github.com/apache/iceberg/pull/13878
Porting custom spark manifest rewrite order to spark 3.4 and 4.0 by @zachdisc in https://github.com/apache/iceberg/pull/13893
Spec, Core: mark 503 as non retryable error code for Update Table by @singhpk234 in https://github.com/apache/iceberg/pull/13619
Flink: Backport#13878 custom source parallelism by @swapna267 in https://github.com/apache/iceberg/pull/13894
Spark: Fix errorprone warning by @ebyhr in https://github.com/apache/iceberg/pull/13896
Spark 3.4, 3.5: Fix errorprone warnings by @ebyhr in https://github.com/apache/iceberg/pull/13897
Flink: Refactor ZkLockFactory to improve code readability and maintainability. by @slfan1989 in https://github.com/apache/iceberg/pull/13795
Spark 4.0: Fix source location in stats file copy plan in RewriteTablePathSparkAction by @anuragmantri in https://github.com/apache/iceberg/pull/13881
Fix S3InputStream.readFully connection leak by @AnatolyPopov in https://github.com/apache/iceberg/pull/13899
spec: be explict about nullability of LoadTableResult's metadata-location by @kevinjqliu in https://github.com/apache/iceberg/pull/13904
update REST spec to clarify AssertRefSnapshotId's snapshot-id field as required by @kevinjqliu in https://github.com/apache/iceberg/pull/13902
Flink: Backport Refactor ZkLockFactory to improve code readability and maintainability. by @slfan1989 in https://github.com/apache/iceberg/pull/13906
Build: Bump nessie from 0.104.3 to 0.104.5 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13910
Build: Bump software.amazon.awssdk:bom from 2.32.24 to 2.32.29 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13911
Build: Bump mkdocs-material from 9.6.17 to 9.6.18 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13912
Docs: Update API docs and remove iceberg-hive3 reference by @ayushjariyal in https://github.com/apache/iceberg/pull/13898
Build: Bump software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3 from 1.2.1 to 1.3.0 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13909
GCP: KeyManagementClient implementation that works with Google Cloud KMS by @szlta in https://github.com/apache/iceberg/pull/13334
Spark 3.4, 3.5: Backport #13881 to fix source location in stats file copy plan in RewriteTablePathSparkAction by @anuragmantri in https://github.com/apache/iceberg/pull/13917
AWS,Azure: Fix S3InputStream and ADLSInputStream connection leaks by @AnatolyPopov in https://github.com/apache/iceberg/pull/13905
Docs: Add docs for Table Maintenance in Flink by @JeonDaehong in https://github.com/apache/iceberg/pull/13853
Docs: Add dltHub to list of vendors by @ShreyasGS in https://github.com/apache/iceberg/pull/13920
Test both vectorized and nonvectorized readers in Parquet golden file tests by @eric-maynard in https://github.com/apache/iceberg/pull/13890
Spec: clarify the partition-spec metadata for Avro manifest file by @stevenzwu in https://github.com/apache/iceberg/pull/13895
Spark: (unit test) Order query result deterministically by @hsiang-c in https://github.com/apache/iceberg/pull/13891
Docs: Add Memiiso Debezium to third party integrations by @ismailsimsek in https://github.com/apache/iceberg/pull/13773
Core: Parallelize cleanFiles() in IncrementalFileCleanup by @gtrettenero in https://github.com/apache/iceberg/pull/13926
Flink: add unit test to check skewness across tasks for range partitioner by @stevenzwu in https://github.com/apache/iceberg/pull/13900
Flink: Improve ConfigOption Descriptions for Flink Table Maintenance Configs. by @slfan1989 in https://github.com/apache/iceberg/pull/13832
Docs: Add OLake to list of vendors by @badalprasadsingh in https://github.com/apache/iceberg/pull/13931
Arrow, Spark: Fix Direct Memory Leak on Vectorized Parquet Mixed Encoding Pages by @RussellSpitzer in https://github.com/apache/iceberg/pull/13935
Spark: Read/Write UnknownType by @Fokko in https://github.com/apache/iceberg/pull/13445
Flink: Backport Improve ConfigOption Descriptions for Flink Table Maintenance Configs. by @slfan1989 in https://github.com/apache/iceberg/pull/13944
Flink: backport PR #13900 for adding unit test of skewness for range partitioner by @stevenzwu in https://github.com/apache/iceberg/pull/13943
OpenAPI: Update the range in format-version (for v3) by @jbonofre in https://github.com/apache/iceberg/pull/13505
Build: Release with JDK17 by @Fokko in https://github.com/apache/iceberg/pull/13946
Docs: Add OLake (ELT) by @badalprasadsingh in https://github.com/apache/iceberg/pull/13929
Only warn if OAuth2 server URI is not set by @1raghavmahajan in https://github.com/apache/iceberg/pull/13741
Docs: metadata deletion doc fix by @yguy-ryft in https://github.com/apache/iceberg/pull/13432
Doc: Flink Maintenance add Delete OrphansFiles part by @Guosmilesmile in https://github.com/apache/iceberg/pull/13923
Build: add spark 4.0 to stage-binaries.sh by @stevenzwu in https://github.com/apache/iceberg/pull/13948
Build: add gradle options --no-parallel and --no-configuration-cache to stage-binaries.sh by @stevenzwu in https://github.com/apache/iceberg/pull/13958
Build: Bump software.amazon.awssdk:bom from 2.32.29 to 2.33.0 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13955
Build: Bump net.snowflake:snowflake-jdbc from 3.26.0 to 3.26.1 by @dependabot[bot] in https://github.com/apache/iceberg/pull/13950
infra: add "how to verify a release" link to the release email template by @kevinjqliu in https://github.com/apache/iceberg/pull/13960
Docs: Update nessie version by @petern48 in https://github.com/apache/iceberg/pull/13969
Test, Spark: Improve the Speed of Rewrite Tests by @RussellSpitzer in https://github.com/apache/iceberg/pull/13947
Data, Flink, Spark: Use TestHelpers for FormatVersion by @RussellSpitzer in https://github.com/apache/iceberg/pull/13880
Infra: update how-to-release.md doc on potential multiple staging repositories in a corp network with floating IPs for outbound requests by @stevenzwu in https://github.com/apache/iceberg/pull/13978
Build: Bump Parquet-Java to 1.16.0 by @Fokko in https://github.com/apache/iceberg/pull/13941
[docs] Add Kafka->Iceberg blog post to blogs.md by @rmoff in https://github.com/apache/iceberg/pull/13965
Core: Use safeContainsKey to avoid NPE for CountNonNull by @jackylee-ch in https://github.com/apache/iceberg/pull/13980
Add a precondition check in allocateFieldVector by @huaxingao in https://github.com/apache/iceberg/pull/13949
[SPEC] Add implementation note about schema evolution by @emkornfield in https://github.com/apache/iceberg/pull/13936
Cleanup TestS3OutputStream integration tests by delegating file clean up to JUnit by @AnatolyPopov in https://github.com/apache/iceberg/pull/13983
Spark: use lookback address for spark session in tests to work with more restrictive firewall env on dev machines by @stevenzwu in https://github.com/apache/iceberg/pull/13993
Spark: backport PR #13993 to use loopback address for spark driver in tests by @stevenzwu in https://github.com/apache/iceberg/pull/13994
REST: Fix already in use problem for RESTCatalogServer by @jackylee-ch in https://github.com/apache/iceberg/pull/13992
Fix versions in LICENSE and NOTICE files by @jbonofre in https://github.com/apache/iceberg/pull/14001

New Contributors

@ccmao1130 made their first contribution in #12860
@szarnyasg made their first contribution in #12932
@mrsubhash made their first contribution in #12894
@akhilputhiry made their first contribution in #12406
@gyfora made their first contribution in #12991
@sundy-li made their first contribution in #13002
@huaxiangsun made their first contribution in #12771
@coderfender made their first contribution in #12901
@hariuserx made their first contribution in #12886
@juldrixx made their first contribution in #13041
@hsingh574 made their first contribution in #12855
@JeonDaehong made their first contribution in #13021
@futurepastori made their first contribution in #13128
@sfc-gh-bhannel made their first contribution in #12975
@Bhargavkonidena made their first contribution in #13113
@plusplusjiajia made their first contribution in #13118
@nika-qubit made their first contribution in #13192
@jmelinav made their first contribution in #13130
@elphastori made their first contribution in #13104
@liziyan-lzy made their first contribution in #12254
@lf-rep made their first contribution in #13242
@nandorKollar made their first contribution in #13244
@jerry153fish made their first contribution in #13221
@yelianevich made their first contribution in #13267
@KyleLin0927 made their first contribution in #13288
@zschumacher made their first contribution in #13325
@jingtao-firebolt made their first contribution in #13350
@liamzwbao made their first contribution in #13072
@zhztheplayer made their first contribution in #13381
@eric-maynard made their first contribution in #13290
@aiborodin made their first contribution in #13340
@CuteChuanChuan made their first contribution in #13217
@Claudenw made their first contribution in #13345
@shubham-diwakar made their first contribution in #13428
@DerGut made their first contribution in #13258
@NikitaMatskevich made their first contribution in #13459
@yogevyuval made their first contribution in #13504
@angelo-DNAStack made their first contribution in #12743
@raveendra11 made their first contribution in #13280
@anoopj made their first contribution in #13507
@davidyuan1223 made their first contribution in #13539
@ChocZoe made their first contribution in #13510
@manirajv06 made their first contribution in #13284
@nryanov made their first contribution in #13621
@bvolpato made their first contribution in #13668
@Smith-Cruise made their first contribution in #13513
@riemenschneider made their first contribution in #13697
@kadai0308 made their first contribution in #13087
@lisancao made their first contribution in #13734
@Elbehery made their first contribution in #13645
@suhwan-cheon made their first contribution in #13743
@msawyer-palantir made their first contribution in #13730
@kamijin-fanta made their first contribution in #13749
@mimaison made their first contribution in #13484
@blakesmith made their first contribution in #13762
@sokojh made their first contribution in #13784
@guixiaowen made their first contribution in #13815
@itamarwe made their first contribution in https://github.com/apache/iceberg/pull/13750
@zachdisc made their first contribution in https://github.com/apache/iceberg/pull/12840
@ayushjariyal made their first contribution in https://github.com/apache/iceberg/pull/13898
@ShreyasGS made their first contribution in https://github.com/apache/iceberg/pull/13920
@gtrettenero made their first contribution in https://github.com/apache/iceberg/pull/13926
@badalprasadsingh made their first contribution in https://github.com/apache/iceberg/pull/13931
@1raghavmahajan made their first contribution in https://github.com/apache/iceberg/pull/13741
@yguy-ryft made their first contribution in https://github.com/apache/iceberg/pull/13432
@petern48 made their first contribution in https://github.com/apache/iceberg/pull/13969

Full Changelog: apache-iceberg-1.9.0...apache-iceberg-1.10.0