opensearch-project/data-prepper 2.5.0

on GitHub

2023-10-09 Version 2.5.0

Features

• Support OpenSearch as source. (#1985)
• Support translate processor. (#1914)
• Support dissect processor. (#3362)
• Support AWS secrets in pipeline and Data Prepper config as an experimental feature. (#2780)

Enhancements

• Support update, upsert, delete bulk actions in OpenSearch sink. (#3109)
• Support inline index templates in OpenSearch sink. (#3365)
• Add retry to Kafka consumer in source. (#3399)
• Support OpenTelemetry SeverityText for logs. (#3280)
• Merging PipelineDataflowModel instead of pipeline YAML files. ([#3289]#3289)
• Support recursive feature in KeyValue processor. (#888)

Bug Fixes

• Fix NullPointerException in S3 scan when bucket kay has null value. (#3316)
• Fix a bug where S3 source does not stop on pipeline shutdown. (#3341)
• Fix exemplar list in Histogram and Count aggregations. (#3364)

Security

• Fix CVE-2023-44487, HTTP/2 reset floods. (#3474)
• Fix CVE-2023-4586. (#3443)
• Fix CVE-2023-39410. (#3430)

Maintenance

• Build with Gradle 8. (#3287)
• Remove sleep from Kafka source timeout test. (#3263)
• Enable Gatling HTTPS support and path configuration. (#3308)
• Support Gatling tests using AWS sigV4 signing. (#3311)
• Support local ARM image build. (#3352)