What's Changed
- Fix lazy import by @pingsutw in #2987
- fix: dbt-test by @taieeuu in #2989
- Async tasks and eager revamp by @wild-endeavor in #2927
- GH-5989: Fix task registration with
node_dependency_hintsby @Tom-Newton in #2992 - Remove eager exception doc by @wild-endeavor in #2995
- Introduce
pod_spec_from_resources()ray helper function by @fiedlerNr9 in #2943 - pin ollama version by @samhita-alla in #2997
- Remove open_async usage in put raw data by @wild-endeavor in #2998
- Specify minio env vars in integration tests by @eapolinario in #3001
- Correct links that end up surfacing in docs by @ppiegaze in #3000
- Unify dependencies in agent image by @eapolinario in #3008
- Faster GitIgnore directory check by @fellhorn in #3007
- Use the same source of time in flaky test by @eapolinario in #3009
- Use correct name in flyteagent test by @eapolinario in #3011
- vscode decorator for the dynamic task by @pingsutw in #2994
- fix: Improve error details and logging config handling by @pingsutw in #3012
- Add python interpreter into vscode settings by @thomasjpfan in #3014
- add support for toggling data mode for array node by @pvditt in #2940
- Store protos in local cache by @eapolinario in #3022
- Bump aiohttp from 3.9.5 to 3.10.11 by @dependabot in #3018
- Fix bug in FlyteDirectory.listdir on local files by @pimdh in #2926
- Fix unit tests in airflow plugin by @pingsutw in #3024
- fix: Fix resource meta typos for async agent by @JiangJiaWei1103 in #3023
- fix: format commands output by @vincent0426 in #3026
- Fix pydantic basemodel default input by @Future-Outlier in #3013
- [BUG] Open FlyteFile from remote path by @JiangJiaWei1103 in #2991
- vllm inference plugin by @dansola in #2967
- Add poetry to image spec by @thomasjpfan in #3025
- [test] Add integration test for accessing sd sttr in dc by @JiangJiaWei1103 in #2969
- [BUG] Map task logging level fixed at 30 for default logger by @pvditt in #3032
- add Optuna plugin by @granthamtaylor in #3035
- add managed environment POC by @granthamtaylor in #3021
- Make launch plan registrable by removing requirement for name by @wild-endeavor in #3043
- Make FlyteFile and FlyteDirectory pickleable by @cosmicBboy in #3030
- fix: set asyncio_default_fixture_loop_scope by @machichima in #3034
- Bump jinja2 from 3.1.3 to 3.1.5 in /plugins/flytekit-onnx-pytorch by @dependabot in #3044
- pin grpcio and grpcio-status <= 1.68.0 by @cosmicBboy in #3046
- Prevent register_launch_plan from re-registering already registered workflow by @wild-endeavor in #3049
- Remove Pydantic V1 plugin by @Future-Outlier in #3040
- Add advanced Optuna plugin authoring methods by @granthamtaylor in #3051
- Place venv in /root when using uv.lock as well by @thomasjpfan in #3062
- Make FlyteUserRuntimeException to return error_code in Container Error by @RRap0so in #3059
- Improve Type Engine Error Msg by @Future-Outlier in #3063
- [Flytekit] Separate remote signal functions by @mao3267 in #2933
- Only copy over cat-certificates.crt if it does not exist in base image by @thomasjpfan in #3067
- Update eager task launching & monitoring by @wild-endeavor in #3042
- Support with_overrides setting metadata for map_task subnode instead of parent node by @pvditt in #2982
- fix: remove duplication log when execute by @vincent0426 in #3052
- Fix: Always propagate pytorch task worker process exception timestamp to task exception by @fg91 in #3057
- Eager deck name by @wild-endeavor in #3072
- Allow user-defined dataclass type transformer (again) by @eapolinario in #3075
- [flyteagent][CLI] Make agent prometheus port configurable by @Future-Outlier in #3064
- Adds python_exec into ImageSpec by @thomasjpfan in #3069
- Add a test for union/dc by @wild-endeavor in #3074
- Add the Flyte agent to provision and manage K8s (data) service for deep learning (GNN) use cases by @shuyingliang in #3004
- Bugfix Omegaconf plugin: Properly deal with NoneType values by @adrianloy in #3056
- Adds secret env_var by @thomasjpfan in #3048
- Fix async coroutine limit not respected and add s3/gcs chunk size by @wild-endeavor in #3080
- Structured datasets in containers (dc/pydantic) by @wild-endeavor in #3086
- Add pip_extra_args by @amitani in #3081
- Enable pydoclint by @eapolinario in #3077
- Also run unit tests on arm64 by @eapolinario in #3085
- Regenerate baseline by @eapolinario in #3090
- Silence union warning by @wild-endeavor in #3091
- Add request and limit to ray config by @pingsutw in #3087
- [BUG] Fix StructuredDataset empty-str
file_formatin dc attr access by @JiangJiaWei1103 in #3027 - Gatenode local execution, was parsing the input twice by @kumare3 in #3101
- prevent compile err for ReferenceWorkflow by @machichima in #3102
- Improve Union Transformer Ambiguous Error Message by @Future-Outlier in #3076
- add ReferenceWorkflow into return type hint by @machichima in #3103
- Tracks progress for package creation, upload and kickoff by @kumare3 in #2935
- Support overriding task pod_template via with_overrides by @arbaobao in #2981
- add project & domain endpoint for FlyteRemote by @fiedlerNr9 in #3108
- [flyte deck] Streaming Decks by @Future-Outlier in #2779
- Fixed type hint by @pimdh in #3110
- Upgrade flyteidl version to 1.14.3 by @arbaobao in #3112
- Bump snowflake-connector-python from 3.12.3 to 3.13.1 by @dependabot in #3113
- Adds validation to Secrets.env_var by @thomasjpfan in #3114
- Fix for keyring errors when initializing Flyte for_sandbox config client by @taieeuu in #2962
- fix: keyring refresh twice by @taieeuu in #3119
- Support mounting secrets by default builder. by @amitani in #3082
- prevent compile err for all reference entities by @machichima in #3122
- Fix dict annotations by @wild-endeavor in #3123
- Attempt to use more specific transformer when executing remote entities by @wild-endeavor in #3111
- Support
FlyteRemote.executeinterruptible flag override by @redartera in #2885 - Improve podtemplate override logic by @arbaobao in #3117
- Bug when calling wf in eager task with thread by @wild-endeavor in #3125
- Bump certifi from 2023.7.22 to 2024.7.4 in /plugins/flytekit-onnx-pytorch by @dependabot in #3127
- Skip test_get_container_error_timestamp on windows by @eapolinario in #3128
- [Flytekit][Test] Structured dataset pickleable test by @mao3267 in #3121
- Flytekit remote updates for notebooks and versions by @kumare3 in #3109
- Execute launchplans declared locally and automatically adjust input params based on fixed and default values by @kumare3 in #3115
- Do not import kubernetes in flytekit core by @thomasjpfan in #3118
- Cache polish work - including the introduction of cache policies to the new top level Cache object by @eapolinario in #3129
- publish pandera deck by @cosmicBboy in #3131
- Fix DeprecationWarning in
pythonjsonlogger>=3.1.0by @patrick-kidger in #3120 - Add shared_memory to task with extended resources by @thomasjpfan in #3096
- Added msgpack support for
pyflyte fetch, storing as JSON by @pimdh in #3130 - Improve Flyte Literal Converter logic by @Future-Outlier in #3134
- Refactor extract_types in Dict Transformer by @Future-Outlier in #3124
- Eager rate limit by @wild-endeavor in #3133
- Add instructions for how to handle failures coming from cache policies by @eapolinario in #3135
- Remove hardcoded ref to docs by @ppiegaze in #3068
- Fix array node empty task executions when using remote by @troychiu in #3136
New Contributors
- @taieeuu made their first contribution in #2989
- @pimdh made their first contribution in #2926
- @vincent0426 made their first contribution in #3026
- @machichima made their first contribution in #3034
- @shuyingliang made their first contribution in #3004
- @adrianloy made their first contribution in #3056
- @amitani made their first contribution in #3081
- @patrick-kidger made their first contribution in #3120
Full Changelog: v1.14.0...v1.15.0