Names are hard and stressful.
Changelog
April 05, 2021
Released on April 5, 2021.
Enhancements
- Add terminal flow state handler override - #4198
- When manually set,
prefect.context.date
will be used to determine dependent values - #4295 prefect.context.date
will be cast to aDateTime
object if given a parsable string - #4295- Expand logging for
DaskExecutor
, including the cluster dashboard address (if available) - #4321 - Add ability to stream ShellTask logs with level INFO - #4322
- Add architecture diagram to docs - #4187
- Speed up flow validation logic - #4347
- Pin dask upper package versions - #4350
Task Library
- Add first basic implementation of Soda SQL Scan task to run DQ tests using soda-sql library
- Add new task KubernetesSecret - #4307
Fixes
- Fix
DatabricksRunNow
task attribute override behavior - #4309 - Use default flow labels when triggering flow runs from CLI - #4316
- Improve ECS agent error messages, and fix bug that prevented using ECS agent on Fargate with ECR - #4325
- Support imports from local directory when registering/building flows via CLI - #4332
- Speedup flushing of logs to cloud/server on flow run shutdown, avoiding lost logs on platforms that SIGKILL the process after a short period - #4334