pathwaycom/pathway v0.18.0

on GitHub

Added

• pw.io.postgres.write and pw.io.postgres.write_snapshot now handle serialization of PyObjectWrapper and Timedelta properly.
• New chunking options in pathway.xpacks.llm.parsers.UnstructuredParser
• Now all Pathway types can be serialized into JSON and consistently deserialized back.
• table.col.dt.to_duration converting an integer into a pw.Duration.
• pw.Json now supports storing datetime and duration type values in ISO format.

Changed

• BREAKING: Changed the interface of UnstructuredParser
• BREAKING: The Pointer type is now serialized and deserialized as a string field in Iceberg and Delta Lake.
• BREAKING: The Bytes type is now serialized and deserialized with base64 encoding and decoding when the JSON format is used. A string field is used to store the encoded contents.
• BREAKING: The Array type is now serialized and deserialized as an object with two fields: shape denoting the shape of the stored multi-dimensional array and elements denoting the elements of the flattened array.
• BREAKING: Marked package as py.typed to indicate support for type hints.

Removed

• BREAKING: Removed undocumented license_key argument from pw.run and pw.run_all methods. Instead, pw.set_license_key should be used.