pathwaycom/pathway v0.26.1

on GitHub

Added

• pw.Table.forget to remove old (in terms of event time) entries from the pipeline.
• pw.Table.buffer, a stateful buffering operator that delays entries until time_column <= max(time_column) - threshold condition is met.
• pw.Table.ignore_late to filter out old (in terms of event time) entries.
• Rows batching for async UDFs. It can be enabled with max_batch_size parameter.

Changed

• pw.io.subscribe and pw.io.python.write now work with async callbacks.
• The diff column in tables automatically created by pw.io.postgres.write and pw.io.postgres.write_snapshot in replace and create_if_not_exists initialization modes now uses the smallint type.
• optimize_transaction_log option has been removed from pw.io.deltalake.TableOptimizer.

Fixed

• pw.io.postgres.write and pw.io.postgres.write_snapshot now respect the type optionality defined in the Pathway table schema when creating a new PostgreSQL table. This applies to the replace and create_if_not_exists initialization modes.