github Netflix/metaflow 2.2.7
2.2.7 (Feb 8th, 2021)

latest releases: 2.18.7, 2.18.6, 2.18.5...
4 years ago

Metaflow 2.2.7 Release Notes

The Metaflow 2.2.7 release is a minor patch release.

Bugs

Handle for-eaches properly for AWS Step Functions workflows running on AWS Fargate

Workflows orchestrated by AWS Step Functions were failing to properly execute for-each steps on AWS Fargate. The culprit was lack of access to instance metadata for ECS. Metaflow instantiates a connection to Amazon DynamoDB to keep track of for-each cardinality. This connection requires knowledge of the region that the job executes in and is made available via instance metadata on EC2; which unfortunately is not available on ECS (for AWS Fargate). This fix introduces the necessary checks for inferring the region correctly for tasks executing on AWS Fargate. Note that after the recent changes to Amazon S3's consistency model, the Amazon DynamoDB dependency is no longer needed and will be done away in a subsequent release. PR: #436

Don't miss a new metaflow release

NewReleases is sending notifications on new releases.