Added
sort_by
method topw.BaseCustomAccumulator
that allows to sort rows within a single batch. Whensort_by
is defined the rows are reduced in the order specified by thesort_by
method. It can for example be used to process entries in the order of event time.
Changed
pw.Table.debug
now prints a whole row in a single line instead of printing each cell separately.- Calling functions without arguments in YAML configurations files is now deprecated in
pw.load_yaml
. To call the function a mapping should be passed, e.g. empty mapping as{}
. In the future!
syntax without any mapping will be used to pass function objects without calling them. - The license check error message now provides a more detailed explanation of the failure.
- When code is run using
pathway spawn
with multiple processes, if one process terminates with an error, all other processes will also be terminated. pw.xpacks.llm.vector_store.VectorStoreServer
is being deprecated, and it is now subclass ofpw.xpacks.llm.document_store.DocumentStore
. Public API is being kept the same, however users are encouraged to switch to usingDocumentStore
from now on.pw.xpacks.llm.vector_store.VectorStoreClient
is being deprecated in favor ofpw.xpacks.llm.document_store.DocumentStoreClient
.pw.io.deltalake.write
can now maintain the target table's snapshot on the output.