github GoogleCloudPlatform/DataflowTemplates 2024-03-27-00_RC00
Dataflow Templates 2024-03-27-00_RC00

latest releases: 2024-11-26-00_RC00, 2024-11-19-00_RC00, 2024-11-12-00_RC00...
8 months ago

Release Week of 2024-03-27

Note: This release is being rolled out. It may not be in your region yet.

New Templates

N/A

Improvements

  • [Python templates] Python UDF Support
  • support vector_length column annotation in DataFlow Import/Export
  • [Spanner-changestreams-to-sharded-file-sink] load test fixes
  • [Flex templates] Extend Python UDF support to GCS flex templates and clean up code reuse
  • Rollback YamlTemplate Beam version to 2.54
  • [DataGenerator templates] Return a bit more accurate count for DataGenerator Template
  • Apache BEAM SDK updates to handle vector length column annotation

Bug Fixes

  • [googlecloud-to-neo4j] Escape fields in generated sql
  • Fix a bug in Stream_GCS_Text_to_BigQuery classic template
  • [Datastream-to-Spanner] Fix conversion to Long
  • [Python UDFs] Change logic to not fail if no UDF is provided.

Contributors

@aksharauke
@ambujojha
@Deep1998
@Dippatel98
@fozzie15
@manitgupta
@Polber

Don't miss a new DataflowTemplates release

NewReleases is sending notifications on new releases.