github GoogleCloudPlatform/DataflowTemplates 2023-03-07-00_RC00
Dataflow Templates 2023-03-07-00_RC00

latest releases: 2024-09-19-00_RC00, 2024-09-18-00_RC00, 2024-09-17-00_RC00...
18 months ago

Release Week of 2023-03-06

Note: This release is in the process of rolling out. It may not be in your region yet.

New Templates

  • Mqtt to Pub/Sub

Improvements

  • [Writes to Elasticsearch] Made trustSelfSignedCerts as parameter
  • [BigQueryIO] Performance tests implemented
  • Load test base implemented
  • [Integration Tests] Add parallelism parameters to allow parallel integration test execution
  • Enable AutoVM Scaevola scans on Dataflow Templates images
  • [DatastreamToSpanner] With this change, the template now accepts only the new HarbourBridge session file with tableID and columnID support. We do not support the older session file.
  • [DataplexBigQueryToGcs] Add more log information for DataplexBigQueryToGcs failures

Bug Fixes

  • [Templates Plugin] Bug fixes when staging templates to Artifact Registry
  • [DatastoreToPubsub] Templates Options interface has been set to public
  • [MqttToPubSub] Fixed MQTT broker server parameter (regular expression)
  • Avoid errors on surefire 2.X.0 due to threadCount=1.0C not supported
  • [CdcToBigQuery] Added null check on update frequency secs

Contributors

@Abacn
@anish97IND
@bvolpato
@Deep1998
@rguillome
@salvob41

Don't miss a new DataflowTemplates release

NewReleases is sending notifications on new releases.