GoogleCloudPlatform/DataflowTemplates 2022-04-11-00_RC00

Dataflow Templates 2022-04-11-00_RC00

on GitHub

Release Week of 2022-04-11

New Templates

• Spanner Change Streams to GCS (only available in repository)

Improvements

• [Datastream to BigQuery] Use stateful transform to handle Oracle rollbacks
• [Datastream to BigQuery] Use txn id and row id for unique rollback values
• [Dataplex JDBC Ingestion] Added writeDisposition option to allow setting a write strategy if file already exists
• [Spanner Import/Export] Support building change streams DDL from information schema

Bug Fixes

• [Datastream to BigQuery] Change DATETIME handling to account for local timezones in Oracle in replication
• [Dataplex Tiering] Fix TIME field handling

Contributors

• dhercher
• nancyxu123
• olegsa
• pranavbhandari
• 1 internal contributor