Added
pw.io.mongodb.readconnector, which reads data from a MongoDB collection. The connector first delivers a full snapshot of the collection and then, if the streaming mode is used, subscribes to the change stream to receive incremental updates in real time.pw.io.postgres.readconnector, which reads data from a PostgreSQL table directly by parsing the Write-Ahead Log (WAL).pw.io.postgres.writeandpw.io.postgres.readnow support serialization/deserialization ofnp.ndarray(int/floatelements), homogeneoustupleandlist(via PostgresARRAY; multidimensional rectangular arrays supported).pw.io.airbyte.readnow accepts adependency_overridesparameter, allowing users to pin specific versions of transitive dependencies (e.g.airbyte-cdk) installed into the connector's virtual environment. This unblocks connectors broken by upstream dependency changes without waiting for upstream fixes.
Changed
- BREAKING:
pw.io.mongodb.writeandpw.io.mongodb.readnow serialize and deserializenp.ndarraycolumns as nested BSON arrays that preserve the array's shape. Previously, all ndarrays were flattened to a single BSON array regardless of dimensionality, making it impossible to reconstruct the original shape on read-back. For 1-D arrays the representation is identical to before ([1, 2, 3]); only multi-dimensional arrays are affected. - BREAKING: The dependencies for
pw.io.pyfilesystem.readare no longer included in the default package installation. To install them, please usepip install pathway[pyfilesystem]. - Asynchronous callback for
pw.io.python.writeis now available aspw.io.OnChangeCallbackAsync. pw.runandpw.run_allnow have theevent_loopparameter to support reusing async state across multiple graph runs.
Fixed
pathway web-dashboardnow waits for the metrics database to be created instead of terminating instantly.