PrefectHQ/prefect 2.14.11 on GitHub

Release 2.14.11

🪄 ✨ Customize resource names when provisioning infrastructure for push work pools

In the past few releases, we've added the ability to provision infrastructure for push work pools via the CLI. This release adds the ability to customize the name of the resources created in your cloud environment when provisioning infrastructure for push work pools so you can follow your organization's naming conventions.

To customize your resource names when provisioning infrastructure for a push work pool, follow the interactive prompts:

? Proceed with infrastructure provisioning with default resource names? [Use arrows to move; enter to select]
┏━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃    ┃ Options:                                                                  ┃
┡━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│    │ Yes, proceed with infrastructure provisioning with default resource names │
│ >  │ Customize resource names                                                  │
│    │ Do not proceed with infrastructure provisioning                           │
└────┴───────────────────────────────────────────────────────────────────────────┘
? Please enter a name for the resource group (prefect-aci-push-pool-rg): new-rg
? Please enter a name for the app registration (prefect-aci-push-pool-app): new-app
? Please enter a prefix for the Azure Container Registry (prefect): newregistry
? Please enter a name for the identity (used for ACR access) (prefect-acr-identity): new-identity
? Please enter a name for the ACI credentials block (new-work-pool-push-pool-credentials): new-aci-block
╭───────────────────────────────────────────────────────────────────────────────────────────╮
│ Provisioning infrastructure for your work pool new-work-pool will require:                │
│                                                                                           │
│     Updates in subscription: Azure subscription 1                                         │
│                                                                                           │
│         - Create a resource group in location: eastus                                     │
│         - Create an app registration in Azure AD: new-app                                 │
│         - Create/use a service principal for app registration                             │
│         - Generate a secret for app registration                                          │
│         - Create an Azure Container Registry with prefix newregistry                      │
│         - Create an identity new-identity to allow access to the created registry         │
│         - Assign Contributor role to service account                                      │
│         - Create an ACR registry for image hosting                                        │
│         - Create an identity for Azure Container Instance to allow access to the registry │
│                                                                                           │
│     Updates in Prefect workspace                                                          │
│                                                                                           │
│         - Create Azure Container Instance credentials block: new-aci-block                │
│                                                                                           │
╰───────────────────────────────────────────────────────────────────────────────────────────╯
Proceed with infrastructure provisioning? [y/n]: y
Creating resource group
Resource group 'new-rg' created successfully
Creating app registration
App registration 'new-app' created successfully
Generating secret for app registration
Secret generated for app registration with client ID '03923189-3151-4acd-8d59-76483752cd39'
Creating ACI credentials block
ACI credentials block 'new-aci-block' created in Prefect Cloud
Assigning Contributor role to service account
Service principal created for app ID '25329389-3151-4acd-8d59-71835252cd39'
Contributor role assigned to service principal with object ID '483h4c85-4a8f-4fdb-0394-bd0f0b1202d0'
Creating Azure Container Registry
Registry created
Logged into registry newregistry1702538242q2z2.azurecr.io
Creating identity
Identity 'new-identity' created
Provisioning infrastructure. ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00
Your default Docker build namespace has been set to 'newregistry1702538242q2z2.azurecr.io'.
Use any image name to build and push to this registry by default:

╭─────────────────────────── example_deploy_script.py ───────────────────────────╮
│ from prefect import flow                                                       │
│ from prefect.deployments import DeploymentImage                                │
│                                                                                │
│                                                                                │
│ @flow(log_prints=True)                                                         │
│ def my_flow(name: str = "world"):                                              │
│     print(f"Hello {name}! I'm a flow running on an Azure Container Instance!") │
│                                                                                │
│                                                                                │
│ if __name__ == "__main__":                                                     │
│     my_flow.deploy(                                                            │
│         name="my-deployment",                                                  │
│         work_pool_name="my-work-pool",                                         │
│         image=DeploymentImage(                                                 │
│             name="my-image:latest",                                            │
│             platform="linux/amd64",                                            │
│         )                                                                      │
│     )                                                                          │
╰────────────────────────────────────────────────────────────────────────────────╯
Infrastructure successfully provisioned for 'new-work-pool' work pool!
Created work pool 'new-work-pool'!

Using a push work pool with automatic infrastructure provisioning is a great way to get started with a production-level Prefect set up in minutes! Check out our push work pool guide for step-by-step instructions on how to get started!

See the following pull requests for implementation details:

📆 🕐 An updated date time input on the workspace dashboard

We've added a new date and time filter to the workspace dashboard that gives greater control over the dashboard. You can now filter by days, hours, and even minutes. You can also specify a specific date and time range to filter by. You can also go backwards and forwards in time using that time window, for example, you can scroll through by hour.

See it in action!

See the following pull requests for implementation details:

💥 Enhancements

Add the ability to publish KubernetesJob blocks as work pools — #11347
Add setting to configure a default Docker namespace for image builds — #11378
Add the ability to provision an ECR repository for ECS push work pools — #11382
Add ability to provision an Artifact Registry repository for Cloud Run push work pools — #11399
Add ability to provision an Azure Container Registry for Azure Container Instance push work pools — #11387
Add support for is_schedule_active to flow.deploy and flow.serve — #11375
Allow users to select relative and fixed date ranges to filter the dashboard — #11406
Add support for arbitrary sink types to prefect.utilities.processutils.stream_text — #11298
Update the Prefect UI deployments page to add run activity and separate out the deployment and flow names — #11394
Update Prefect UI workspace dashboard filters to use new date range - PrefectHQ/prefect-ui-library#1937

🧰 Fixes

Fix bug where a pause state reused an existing state ID — #11405

🧪 Experimental

Build out API for creating/reading/deleting flow run inputs — #11363
Integrate flow run input and schema/response mechanics into pause/suspend — #11376
Add typing overloads for pause/suspend methods — #11403
Use bytes for value in create_flow_run_input — #11421
Validate run input when resuming flow runs — #11396
Run existing deployments via the Runner webserver — #11333

🧠 Documentation

Add instructions for automatic infrastructure provisioning to the push work pools guide — #11316
Fix broken links in states concept doc and daemonize guide — #11374
Update agent upgrade guide to include flow.deploy and examples — #11373
Update block document names in Moving Data guide — #11386
Rename Guides to How-to Guides — #11388
Add guide to provision infrastructure for existing push work pools — #11365
Add documentation for required permissions for infrastructure provisioning — #11417
Add docs for managed execution open beta — #11397, #11426, and #11425

PrefectHQ/prefect 2.14.11 Release 2.14.11 on GitHub