Release Week of 2023-02-07
Note: This release is in the process of rolling out. It may not be in your region yet.
Improvements
- Improve and cleanup README.md, moving plugins documentation up
- [Avro Import Template] Logging schema operations.
- [Datastream To Spanner Template] Add transactions tags to the writes.
- [Performance Tests] Draft of PS Lite to BigTable perf test.
- [Datastream to BigQuery Template] Add flag and option to use deterministic job id
- [Templates Plugin] Add conscrypt to classpath before other libraries, exclude shaded JAR containing libconscrypt from common
- [Integration Tests] waitForConditionAndCancel should trigger job cancellation instead of draining
- [Syndeo Template] Test for create never behavior on BQ
- [Integration Tests] Create BigQueryToElasticsearchIT, include GCSToElasticsearchIT ES6 variant
- Adds new license() rules, load statements and, default_applicable_license attributes for root third party packages.
- [Integration Tests] Increase coverage in Bulk(Compressor|Decompressor)IT
- [Integration Tests] Create test for FileFormatConversion (+ Avro and Parquet utilities)
- [Plugin] Improve metadata parent, allow checkstyle check across project
- [JdbcToBigQuery] ConnectionProperties should not be mandatory
- [Integration Tests] Initial test for TextImportPipeline (GCS to Spanner) template
- [Integration Tests] Initial test for PubSubToElasticsearch template
- [Integration Tests] Change Kafka Bootstrap Server / topics list param to accept commas.
- [Common] Allow usage of a different project id when doing merge
- [UDF] Create unit tests for udf-samples
- [DataStream to BigQuery] Remove determinstic id flag and assign merge jobs to workers by table name and merge concurrency limit instead of randomly
Bug Fixes
- [Integration Tests] Improve names to use generic Beam terms
- [Syndeo Template] Generate BQ and PS configs properly
- [Datastream to BigQuery Template] Fix deterministic uuid generation
- [Templates Plugin] Fix stage for projects containing ":"
- [Security] Bump mysql-connector-java to 8.0.30
- [Syndeo Template] Update proto-java to 3.21.9 to resolve conflicts