github GoogleCloudPlatform/DataflowTemplates 2022-11-16-00_RC00
Dataflow Templates 2022-11-16-00_RC00

latest releases: 2024-04-23-00_RC00, 2024-04-16-00_RC01, 2024-04-02-00_RC00...
17 months ago

Release Week of 2022-11-16

Note: This release is in the process of rolling out. It may not be in your region yet.

New Templates

Text-to-BigQuery Flex template with support for BQ Storage Write API

Improvements

  • [All templates] Upgrade Beam version to 2.42.
  • [Batch Flex template with BQ Sinks] BQ Storage Write API options for Batch Flex Templates
  • [Syndeo] Add Jib to syndeo-template module and bind it to the package phase for the Syndeo template
  • [Syndeo] Handle schemas that are not provided by configuration
  • [Flex templates] Enable structured logging for v2 templates
  • [All templates] Enforce Conscrypt version 2.5.2 (matching Beam 2.42.0)
  • [All templates] Update commons-text
  • [BigTable templates] update bigtable-beam-import version
  • [Spanner templates] Supported new value capture types (NEW_VALUES and NEW_ROW).

Bug Fixes

  • pom file name fix in .github/workflows/prepare-java-cache.yml
  • [Unit tests] Reducing verbosity of unit test logs

Contributors

@bvolpato
@oleg-semenov
@pabloem
@pranavbhandari24
@zhoufek

Don't miss a new DataflowTemplates release

NewReleases is sending notifications on new releases.