github redpanda-data/connect v4.112.0

6 hours ago

For installation instructions check out the getting started guide.

Added

  • postgres_cdc: Added incremental snapshot support to Postgres CDC, enabling tables to be backfilled in chunks while replication continues running, eliminating the need for snapshot-induced stream blocking or restart from the beginning. (@josephwoodward, #4811)
  • oracledb_cdc: Implemented a log_count based algorithm for the Oracle CDC window strategy to improve change capture efficiency. (@josephwoodward, #4864)
  • opensearch: Added compress_request_body option to the OpenSearch output to enable gzip compression of HTTP request bodies, reducing bandwidth usage on cross-cloud or cross-region bulk writes. (@doradojl, #4896)

Fixed

  • gcp_spanner_cdc: Fixed Cloud Spanner CDC metadata indexes being recreated on every connector restart by deriving index names deterministically from a hash instead of generating new UUIDs, preventing the 128-index-per-table limit from being exceeded. (@bfbarkhouse-redpanda, #4830)
  • iceberg: Fixed table creation and schema evolution failures with nanosecond timestamp columns by validating and rejecting unsupported nanosecond timestamp types before creating or modifying tables. (@squiidz, #4853)
  • metrics: Fixed Prometheus histogram timing metrics being incorrectly exported with _ns suffix instead of _seconds, which caused remote-write targets to reject batches when mixed use_histogram_timing settings were present in a fleet. (@squiidz, #4546)
  • oracledb_cdc: Fixed Oracle CDC losing LOB (Large Object) updates when transactions contained only LOB events without DML events, by tracking LOB event SCNs and holding the commit checkpoint until all open LOB transactions complete. (@Leward, #4902)

Changed

  • kafka: Removed the schema registry fixed-ID workaround for Redpanda versions before 25.3 by leveraging native IMPORT mode support, now requiring the destination registry to be in IMPORT mode when translate_ids is false. (@Jeffail, #4843)

The full change log can be found here.

Don't miss a new connect release

NewReleases is sending notifications on new releases.