GoogleCloudPlatform/DataflowTemplates 2023-10-03-00_RC01

Dataflow Templates 2023-10-03-00_RC01

on GitHub

Release week of 2023-10-03

Note: This release is being rolled out. It may not be in your region yet.

Bug Fixes

• [Spanner Change stream to BigQuery] Add support for datatype pg_numeric
• Fix racing during tear down on Neo4j IT
• Use waitUntilDone instead of Finish, as batch jobs can not be drained.
• [Bigtable CDC] Add random string on app profile id to increase entropy
• Fix format for bigtableChangeStreamAppProfile.
• Remove note that GCS to BigQuery doesn't support structs.
• [MQTT to Pub/Sub] Fix username/password validation logic.

Improvements

• Add documentation details to Google Ads to BigQuery template
• Bump org.xerial.snappy:snappy-java from 1.1.10.3 to 1.1.10.4
• Hide some templates from UI to match current releases.
• Update release script to execute tests and publish artifacts.
• Add requirementsFile parameter to LaunchConfig.
• Improve annotations / regenerate docs
• Add parallelism to release workflow.
• Fix errorprone alerts for templates
• Exclude python templates from releases.

Contributors

@an2x
@bvolpato
@pranavbhandari24