PrefectHQ/prefect 1.0.0

Release 1.0.0

on GitHub

🎉

See the latest documentation and our release blog post.

Highlights

• Authentication with tokens has been removed; use API keys instead. - #4643
• Python 3.6 is no longer supported; use Python 3.7+ instead. - #5136
• Flow Environments have been removed; use RunConfigs instead. - #5072, docs
• We have a new Discourse community to encourage lasting discussions.

Breaking Changes

• The AWS Fargate agent has been removed; use the ECS agent instead. - #3812
• DockerAgent(docker_interface=...) will now raise an exception if passed. - #4446
• Agents will no longer check for authentication at the prefect.cloud.agent.auth_token config key. - #5140

• Executors can no longer be imported from prefect.engine.executors; use prefect.executors instead. - #3798
• Parameter is not importable from prefect.core.tasks anymore; use prefect.Parameter instead.
• Exceptions are no longer importable from prefect.utilities.exceptions; use prefect.exceptions instead. - #4664
• Client.login_to_tenant has been renamed to Client.switch_tenant.

• The prefect register flow command has been removed; use prefect register instead. - #4256
• The prefect run flow command has been removed; use prefect run instead. - #4463
• Authentication token CLI commands create-token, revoke-token, list-tokens have been removed; use API keys instead. - #4643
• prefect auth login no longer accepts authentication tokens. - #5140
• prefect auth purge-tokens has been added to delete the Prefect-managed tokens directory. - #5140

• The log_to_cloud setting is now ignored; use send_flow_run_logs instead. - #4487

Enhancements

• Update LocalDaskExecutor to use new Python futures feature. - #5046
• Add a State.__sizeof__ implementation to include the size of its result for better scheduling. - #5304
• Allow the cancellation event check to be disabled in the DaskExecutor. - #5443
• Update Flow.visualize() to allow change in orientation. - #5472
• Allow ECS task definition role ARNs to override ECS agent defaults. - #5366

Task Library

• Add DatabricksGetJobID to retreive Databricks job IDs with a given name. - #5438
• Add AWSParametersManager task to retrieve value from AWS Systems Manager Parameter Store. - #5439
• Update SpacyNLP task to support spacy version >= 3.0. - #5358
• Add exclude parameter to SpacyNLP task. - #5402
• Update the AWSSecretsManager task to parse non key-value type secrets. - #5451
• Update the DatabricksRunNow task to use the Databricks 2.1 jobs API. - #5395
• Add ge_checkpoint and checkpoint_kwargs parameters to RunGreatExpectationsValidation to allow runtime configuration of checkpoint runs. - #5404
• Add support for overwriting existing blobs when using Azure BlobStorageUpload task. - #5437
• Add Neo4jRunCypherQueryTask task for running Cypher queries against Neo4j databases. - #5418
• Add DatabricksSubmitMultitaskRun task to run Databricks jobs with multiple Databricks tasks. - #5395

Fixes

• Add support to prefect.flatten for non-iterable upstreams, including exceptions and signals. - #4084
• While building Docker images for storage, rm=True is used as default, which deletes intermediate containers. - #5384
• Use __all__ to declare Prefect's public API for Pyright. - #5293
• Fix usage of sys.getsizeof to restore support for PyPy. - #5390
• Fix issues with log size estimates from #5316. - #5390

Contributors

• Alessandro Lollo
• Aneesh Makala
• Connor Martin
• Gebing
• Julio Faracco
• Kevin Mullins
• Mathijs Miermans
• Oliver Mannion
• Raymond Yu