Data subsystem now uses fsspec, partial support for maps, python 3.11, flyte file/directory streaming, device auth flow.
Please see the Flyte release notes for usage snippets.
Full changelog below.
What's Changed
- prefer FLYTE_ prefixed AWS creds env vars by @flixr in #1523
- Filter out remote entity when generating pb by @honnix in #1545
- Pyflyte docs formatting by @bryanwweber in #1538
- Data subsystem by @wild-endeavor in #1526
- Less strict docker dependency versions by @jcugat in #1536
- Pluck retry from flytekit and into sagemaker by @eapolinario in #1411
- Update the pypi wait by @wild-endeavor in #1554
- Stream Directories and Files using Flyte by @kumare3 in #1512
- Make
FlyteFilecompatible withAnnotated[..., HashMethod]by @AdrianoKF in #1544 - move FlyteSchema deprecation warning to initialization method by @cosmicBboy in #1558
- add pod_template and pod_template_name arguments for ContainerTask by @flixr in #1515
- Pass locally defined scopes to RemoteClientConfigStore by @franco-bocci in #1553
- TypeTransformer for TensorFlow model by @samhita-alla in #1562
- Remove flytekit-fsspec plugin from default dockerfile by @wild-endeavor in #1561
- Device auth flow / Headless auth by @kumare3 in #1552
- support python 3.11 by @cosmicBboy in #1557
- url encode secret in client credentials flow by @wild-endeavor in #1566
- Python run multiple files by @pingsutw in #1559
- General Partial support in flytekit and multi-list support in flytekit by @kumare3 in #1556
- fix: Silence keyring warnings by changing to debug by @ggydush in #1568
- Support GCP secrets by @wild-endeavor in #1571
- Automatically remove unused import by @pingsutw in #1574
- Disallow partial lists in map tasks by @eapolinario in #1577
- Remove duplicate reporting logic by @wild-endeavor in #1578
- [Core feature] Convert List[Any] to a single pickle file by @Yicheng-Lu-llll in #1535
- Improve authoring structure documentation by @samhita-alla in #1572
New Contributors
- @bryanwweber made their first contribution in #1538
- @franco-bocci made their first contribution in #1553
- @ggydush made their first contribution in #1568
- @Yicheng-Lu-llll made their first contribution in #1535
Full Changelog: v1.4.2...v1.5.0