github GoogleCloudPlatform/DataflowTemplates 2023-07-18-00_RC00
Dataflow Templates 2023-07-18-00_RC00

latest releases: test_2024-09-20-00, 2024-09-19-00_RC00, 2024-09-18-00_RC00...
14 months ago

Release Week of 2023-07-18

Note: This release is being rolled out. It may not be in your region yet.

Highlights

  • Apache Beam was updated to 2.49.0

New Templates

  • MySQL to BigQuery
  • PostgreSQL to BigQuery
  • SQL Server to BigQuery (branding of JDBC to BigQuery)

Improvements

  • [PubSubToDatadog] Several improvements, including batching and parallelism optimization
  • [GoogleCloudToNeo4j] Several improvements to statement generation and merging
  • [Testing] Allow usage of Bigtable static instances
  • [Testing] DLP resource manager + integration tests

Bug Fixes

  • [Security] Enforce non-vulnerable version of jettison dependency
  • [Security] Bump hadoop-version to 3.3.6
  • [Encoding] Ensure byte array to String is converted as UTF-8
  • [Testing] Reduce the test name to fulfill the 30 chars limit
  • [Spanner] Removing default spanner retryable codes
  • [PubSubToDatadog] Retry 408 and 429 in addition to 5xx
  • [SpannerChangeStreamsToSink] [OrderederedChangestreamBufferToSource]

Contributors

@aksharauke
@ash-ddog
@bvolpato
@Dippatel98
@fbiville
@leerazo
@pranavbhandari24

Don't miss a new DataflowTemplates release

NewReleases is sending notifications on new releases.