Metaflow 2.3.1 Release Notes

The Metaflow 2.3.1 release is a minor release.

• Features
  • Performance optimizations for merge_artifacts

Features

Performance optimizations for merge_artifacts

Prior to this release, FlowSpec.merge_artifacts was loading all of the merged artifacts into memory after doing all of the consistency checks with hashes. This release now avoids the memory and compute costs of decompressing, de-pickling, re-pickling, and recompressing each merged artifact - resulting in improved performance of merge_artifacts.