What's Changed

🎉 Exciting New Features

🗑️ Delete backfills

• Add delete button to backfills table that allows user to delete backfills individually.
• Prevent user from setting a backfill interval unit value less than 1, which could cause issues loading the backfills.

by @johnson-mage in #4726

🪪 Support AzureDevOps using Entra ID/AD authentication

If you have an Azure DevOps organization connected to your Active Directory/Microsoft Entra ID tenant, you can enable DevOps in the version control app.

• First, you will need to enable the Active Directory integration in order for Mage to authenticate your user.
• Once the Active Directory integration is enabled, you simply need to add your DevOps organization as an environment variable, and you should be able to authenticate with DevOps in the version control app
  • export AZURE_DEVOPS_ORGANIZATION=<organization_name>

by @dy46 in #4721

📅  Scheduler status endpoint

Add /api/status endpoint to scheduler when running scheduler in standalone mode.
This endpoint can be used to check the liveness of the scheduler.

by @wangxiaoyou1993 in #4736

🔐 Read authentication settings from AWS secrets manager

Add support for reading settings from AWS secrets manager. The existing authentication settings have been moved to using the new Settings class.

In order to set the settings backend, the user will need to add a section to the project metadata. Here is an example to set the setting backend to AWS secrets manager:

settings_backend:
  backend_type: aws_secrets_manager
  prefix: default_repo/settings/

Read the doc for details.

by @dy46 in #4674

💅 Enhancements & Polish

• [jk] Limit block output for dynamic blocks in UI by @johnson-mage in #4693
• [xy] Add auto clean name flag to io classes. by @wangxiaoyou1993 in #4698
• [dy] Add interval variables for cron based schedules by @dy46 in #4699
• [dy] Add error stack trace to the message for pipeline run failure by @dy46 in #4697
• [dy] Add unique_conflict_method for mssql by @dy46 in #4712
• [jk] Scrollbar polish by @johnson-mage in #4732
• [xy] Remove Redshift stl insert query. by @wangxiaoyou1993 in #4735
• [edw] e2e test: load pages no errors by @edmondwinston in #4429
• [dy] Share main project logging config with workspaces by @dy46 in #4656

🐛 Bug Fixes

• [jk] Fix "filter is not a function" type error in schema props by @johnson-mage in #4686
• [xy] Fix list index out of range for dynamic blocks. by @wangxiaoyou1993 in #4688
• [xy] Set default domain for salesforce source by @wangxiaoyou1993 in #4689
• [dy] Handle JSON reading errors for elasticsearch by @dy46 in #4696
• [dy] Add try/except by @dy46 in #4683
• [jk] Update backfill policy to allow update on settings by @johnson-mage in #4706
• [dy] Fix logging for elasticsearch destination by @dy46 in #4709
• [xy] Add upstream_dbt_blocks method back to DBTBlockSQL. by @wangxiaoyou1993 in #4711
• [jk] Bugfix for pipeline interactions by @johnson-mage in #4710
• [xy] Catch sync schedules exception. by @wangxiaoyou1993 in #4717
• [xy] Fix pipeline metadata encoding issue. by @wangxiaoyou1993 in #4718
• [jk] Fix buggy pipeline dashboard by @johnson-mage in #4714
• Bugfix: Fix migration crash when using MSSQL as mage database by @tuokor in #4695
• [xy] Set repo_path when syncing trigger configs. by @wangxiaoyou1993 in #4719
• [jk] Allow file to be opened in Pipeline Editor without Command Center enabled by @johnson-mage in #4728
• [jk] Bugfix dock overlay by @johnson-mage in #4733
• [dy] Display error on oauth by @dy46 in #4734
• [jk] Avoid client error when making request before interactions are done loading by @johnson-mage in #4744
• Trino temp table location fix - Fixes issue #4738 by @sumanshusamarora in #4739
• [xy] Fix alter Snowflake table with lower_case=false by @wangxiaoyou1993 in #4750
• [jk] Fix block run sorting by @johnson-mage in #4751
• [dy] Fix sign in issue by @dy46 in #4753
• [dy] Fix elasticsearch destination by @dy46 in #4687
• fix the incorrect spelling by @ckfear in #4680
• [Bug] Resolve "parsing error" in the trino.mdx screen by @devharipragaz007 in #4702
• Pyarrow version conflicts from Snowflake connector by @Jawahars in #4707
• [dy] Update access token user queries and add tests by @dy46 in #4713
• bug fix with stripe sync by @sumanshusamarora in #4748

✨ New Contributors

• @devharipragaz007 made their first contribution in #4702
• @Jawahars made their first contribution in #4707
• @tuokor made their first contribution in #4695

Full Changelog: 0.9.65...0.9.66