For installation instructions check out the getting started guide.
Added
- bloblang: Added native prune_empty method to remove null values, empty arrays, and empty objects from documents, with 16x performance improvement over recursive map implementations. (@Leward, #5238)
- iceberg: Iceberg now automatically expires old snapshots based on commit.max_snapshot_age to prevent metadata file bloat and catalog size limit breaches. (@Jeffail, #5218)
- iceberg: Iceberg now enables manifest merging on tables when commit.manifest_merge_enabled is configured, reducing metadata overhead. (@Jeffail, #5219)
- kafka: Kafka output now warns and counts when the broker rejects messages, with configurable warning intervals. (@squiidz, #5186)
- telemetry: Telemetry now reports container CPU and memory limits in millicores and bytes, enabling accurate compute unit tracking for cloud deployments. (@prakhargarg105, #5244)
Fixed
- aws_dynamodb: DynamoDB output now continues writing the rest of the batch when individual messages fail to build. (@squiidz, #5189)
- aws_kinesis: Kinesis shard discovery now properly follows ListShards pagination to discover all shards. (@squiidz, #5190)
- general: Credentials in connection strings, URLs, and configuration are now redacted from error messages and logs across all connectors and components. (@Jeffail, #4975)
- iceberg: Iceberg prohibited-key retry now runs correctly when max_retries is 1 instead of never executing. (@Jeffail, #5217)
- influxdb: InfluxDB metrics output now properly applies the timeout field to write operations, preventing indefinite hangs. (@Leward, #5210)
- kafka: Kafka output now correctly sends empty or null output keys as null instead of serialized values. (@squiidz, #5191)
- oracledb_cdc: Concurrent pipeline starts on the same table no longer fail when both attempt to create the checkpoint cache table simultaneously. (@Leward, #4887)
Changed
- azure_queue_storage: Rejected messages are now redelivered instead of deleted, with a configurable visibility timeout reset option. (@squiidz, #5188)
- cli: CLI dry-run help text now better explains what it does and which files it reads. (@JakeSCahill, #5194)
The full change log can be found here.