redpanda-data/connect v3.32.0

on GitHub

For installation instructions check out the getting started guide.

Added

• The csv input now supports glob patterns in file paths.
• The file input now supports multiple paths, glob patterns, and a range of codecs.
• New experimental aws_s3 input.
• All redis components now support TLS.
• The -r cli flag now supports glob patterns.

Fixed

• Bloblang literals, including method and function arguments, can now be mutated without brackets regardless of where they appear.
• Bloblang maps now work when running bloblang with the blobl subcommand.

Changed

• The ristretto cache no longer forces retries on get commands, and the retry fields have been changed in order to reflect this behaviour.

• The files input has been deprecated as its behaviour is now covered by file.

• Numbers within JSON documents are now parsed in a way that preserves precision even in cases where the number does not fit a 64-bit signed integer or float. When arithmetic is applied to those numbers (either in Bloblang or by other means) the number is converted (and precision lost) at that point based on the operation itself.

  This change means that string coercion on large numbers (e.g. root.foo = this.large_int.string()) should now preserve the original form. However, if you are using plugins that interact with JSON message payloads you must ensure that your plugins are able to process the json.Number type.

  This change should otherwise not alter the behaviour of your configs, but if you notice odd side effects you can disable this feature by setting the environment variable BENTHOS_USE_NUMBER to false (BENTHOS_USE_NUMBER=false benthos -c ./config.yaml). Please raise an issue if this is the case so that it can be looked into.

The full change log can be found here.