redpanda-data/connect v4.31.0 on GitHub

For installation instructions check out the getting started guide.

4.31.0 - 2024-07-19

The splunk input and splunk_hec output now support custom tls configuration. (@mihaitodor)
Field timestamp added to the kafka and kafka_franz outputs. (@mihaitodor)
(Benthos) Field max_retries added to the retry processor. (@mihaitodor)
(Benthos) Metadata fields retry_count and backoff_duration added to the retry processor. (@mihaitodor)
(Benthos) Parameter escape_html added to the format_json() Bloblang method. (@mihaitodor)
(Benthos) New array bloblang method. (@gramian)
(Benthos) Algorithm fnv32 added to the hash bloblang method. (@CallMeMhz)
New experimental redpanda_data_transform. (@rockwotj)
New -community suffixed build included in release artifacts, containing only FOSS functionality. (@Jeffail)
New -cloud suffixed build included in release artifacts, containing components enabled in Redpanda Cloud. (@Jeffail)
Field status_topic added to the global redpanda config block. (@Jeffail)
New pinecone output. (@rockwotj)
(Benthos) The /ready endpoint in regular operation now provides a detailed summary of all inputs and outputs, including connection errors where applicable. (@Jeffail)

(Benthos) All cli subcommands that previously relied on root-level flags (streams, lint, test, echo) now explicitly define those flags such that they appear in help-text and can be specified after the subcommand itself. This means previous commands such as connect -r ./foo.yaml streams ./bar.yaml can now be more intuitively written as connect streams -r ./foo.yaml ./bar.yaml and so on. The old style will still work in order to preserve backwards compatibility, but the help-text for these root-level flags has been hidden. (@Jeffail)