github redpanda-data/connect v4.118.0

28 minutes ago

For installation instructions check out the getting started guide.

Added

  • azure: Azure Blob Storage output now supports blob index tags for organizing and filtering blobs, with configuration-time validation and best-effort tag application for pre-existing append blobs. (@cadiidii, #4204)
  • telemetry: Pipeline ID from the control plane is now included in the anonymous telemetry payload for correlation with usage and billing data. (@prakhargarg105, #4758)

Fixed

  • dynamodb: DynamoDB CDC input now correctly deduplicates snapshots and CDC events across different time zones and within the same second. (@Leward, #5057)
  • dynamodb: AWS DynamoDB CDC input now properly resumes snapshots with the correct segment count. (@squiidz, #5181)
  • dynamodb: AWS DynamoDB CDC input now retries table coordinator shard refresh on failure instead of giving up. (@squiidz, #5182)
  • influxdb: InfluxDB metrics exporter now properly stops its flush loop on close, preventing goroutine leaks and duplicate metric writes. (@Leward, #5130)
  • kafka: Sarama Kafka output now supports idempotent writes by properly configuring RequiredAcks and MaxOpenRequests when idempotent_write is enabled. (@Leward, #5167)
  • mongodb: MongoDB CDC input now ensures the incremental snapshot waits for the majority snapshot to reach the stream start, preventing data loss from concurrent writes. (@Leward, #5132)
  • mssqlserver: SQL Server CDC input now correctly captures streaming changes by clearing snapshot messages before streaming inserts. (@Leward, #5122)
  • postgres: PostgreSQL CDC input now prevents parallel snapshot chunks from moving each other's bounds during processing. (@josephwoodward, #5204)
  • sftp: SFTP input now correctly counts minimum_age from whole-second modification times, preventing premature reads of files with incomplete data. (@Leward, #5125)

Changed

  • oracledb: Oracle CDC input now uses partitioned table snapshots for improved performance and reliability when capturing changes from large tables. (@josephwoodward, #5006)
  • otel: Update to OTEL package to address CVE includes breaking change (see here) - use go.opentelemetry.io/otel/attribute.Value and go.opentelemetry.io/otel/attribute.KeyValue for log bodies and attributes in go.opentelemetry.io/otel/log, go.opentelemetry.io/otel/log/logtest, go.opentelemetry.io/otel/sdk/log, and go.opentelemetry.io/otel/sdk/log/logtest. (@josephwoodward, #5207)

The full change log can be found here.

Don't miss a new connect release

NewReleases is sending notifications on new releases.