github GoogleCloudPlatform/DataflowTemplates 2024-01-09-00_RC01
Dataflow Templates 2024-01-09-00_RC01

latest releases: 2024-07-01-00_RC00, 2024-06-25-00_RC00, 2024-06-18-00_RC01...
5 months ago

Release Week of 2024-01-09

Note: This release is being rolled out. It may not be in your region yet.

Improvements

  • [FirestoreToBigQuery] Support CreateDisposition, withMethod, and schema
  • [JdbcToBQ] Support create disposition and assign BQ schema
  • [YamlTemplate] Change template parameters from --yaml to --yaml_pipeline and --yaml_pipeline_file
  • Add Streaming flag to Template annotation
  • Make schema unique to improve debugability of test racing condition
  • Cleanup ModelColumn builder TODOs
  • Match IT framework with Beam diffs (soon to be consolidated)
  • Change JVM config to prefer IPv4 stack

Bug Fixes

  • Fix cascading NPE when there was a failure launching the pipeline
  • Fix pipeline name record in metrics
  • [Security] Bump kafka-clients due to CVE-2021-38153
  • [Security] Bump ch.qos.logback:logback-classic from 1.2.10 to 1.2.13 in /structured-logging

Contributors

@adrw-google @bvolpato @Dippatel98 @Polber @Abacn @aksharauke

Don't miss a new DataflowTemplates release

NewReleases is sending notifications on new releases.