For installation instructions check out the getting started guide.
Added
- mongodb_cdc: Input now adds
schemametadata to consumed messages. Schema is extracted from the collection's$jsonSchemavalidator when available, otherwise inferred from document structure. This can be used for automatic schema conversion in processors such asparquet_encode. (@Jeffail) - oracledb_cdc: Adds support for CDC via LogMiner (@josephwoodward)
- benthos: Add NewMessageWithContext to service package for constructing messages with an associated context. (@prakhargarg105)
- redpanda(migrator): refcount-based IMPORT mode management for serverless SR (@mmatczuk)
- Go API: Added composable HTTP client with layered RoundTripper chain (@mmatczuk)
Changed
- microsoft_sql_server_cdc: The
schemametadata field (containing the SQL schema name of the source table) has been renamed todatabase_schema. Thecommon_schemametadata field (containing the benthos common schema) has been renamed toschemafor consistency with themysql_cdcandpostgres_cdcinputs. (@Jeffail)
Fixed
- mysql_cdc: replace deprecated 'SHOW MASTER STATUS' for 8.4+ (@josephwoodward)
- postgresql_cdc: fix issue with hang due to chunksize being 0 (@josephwoodward)
The full change log can be found here.