github GoogleCloudPlatform/DataflowTemplates 2023-08-01-00_RC00
Dataflow Templates 2023-08-01-00_RC00

latest releases: test_2024-09-20-00, 2024-09-19-00_RC00, 2024-09-18-00_RC00...
13 months ago

Release Week of 2023-08-01

Note: This release is being rolled out. It may not be in your region yet.

New Templates

Add a v2 flex dynamic template to import data from AstraDb into BigQuery

Improvements

Add an option to the Bigquery template to disable retries for the DLQ. Instead of writing failed elements into the retry DLQ, we will write into the permanent DLQ on the first try.
Support Import/Export of Sequences in PostgreSQL dialect databases
Support Sequence Import/Export in Dataflow templates, for GoogleSQL dialect databases.
Update Bigtable-Hbase replicator name to Bigtable_Change_Streams_to_Hbase and fix HbaseIO
[SpannerChangeStreamToSink] Add support for handling DELETES in the template when the shard id column is not part of the primary key.
Allow UDF reloading for streaming templates
Introduce optionsOrder and skipOptions for ChangeStreams templates

Bug Fixes

N/A

Contributors

@bvolpato
Florent Biville
Ozzie Fernandez
@aksharau
@AlexeyKu
@clun
@fozzie15
@georgema-google
@pranavbhandari24

Don't miss a new DataflowTemplates release

NewReleases is sending notifications on new releases.