Release 2023-10-29
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Kubernetes 1.25 is being deprecated at the end of January 2024 and support will transition to our platform support policy.
- No new clusters can be created with Azure AD Integration (legacy). Existing AKS clusters with Azure Active Directory integration will keep working. All Azure AD Integration (legacy) AKS clusters will be migrated to AKS-managed Azure AD automatically starting from December 1st, 2023. We recommend updating your cluster with AKS-managed Azure AD before December 1st, 2023. This way you can manage the API server downtime during non-business hours.
- Starting January 2024, due to Gatekeeper Upstream removing validation for constraint template contents at create/update time, the Azure Policy Add-On will now no longer support this. The Azure Policy Add-On will report ‘InvalidConstraint/Template’ compliance reason code for detected errors after constraint template admission. This change does not impact other compliance reason codes. Customers are encouraged to continue to follow best practices when updating Azure Policy for Kubernetes definitions (i.e. Gator CLI).
- Windows containerd v1.7 will be the default container runtime for k8s v1.28+ on AKS Windows nodes. Windows Host Process (HPC) containers is GA in Windows containerd v1.7 and it has some breaking changes.
- Starting Kubernetes 1.29, the default cgroups implementation on Azure Linux AKS nodes will be cgroupsv2. Older versions of Java, .NET and NodeJS do not support memory querying v2 memory constraints and this will lead to out of memory (OOM) issues for workloads. Please test your applications for cgroupsv2 compliance, and read the FAQ for cgroupsv2.
- AKS sent out an advisory regarding CVE-2023-29332 on September 13, 2023, which impacts AKS agent nodes. Recommended mitigation is to upgrade AKS cluster and AKS node image. If impacted clusters are not upgraded, AKS will apply mitigation on customer's next cluster update operation including node OS updates and node rolling upgrades, which may cause workload disruption.
Release notes
- Preview Features
- Windows Disable Outbound NAT (Preview) now supports WS2019 and WS2022.
- Bug Fixes
- Corrected issue where on tainted/dedicated system pools the Vertical Pod Autoscaler (VPA) deployment could end up on non-system pools.
- Fix for issue where a Certificate Authority bundle mismatch could produce an update on the image version of the VPA webhook.
- Fix for possible deadlock scenario between Container Network Service and Azure CNI where pod IPs would not release on pod delete and new pods would not get an IP.
- Fix for Windows NPM crashes in k8s 1.28 with Containerd 1.7. Bug was a result of Windows NPM DaemonSet referencing a file that did not exist in its current directory.Containerd 1.7.
- Fix for fleet clusters, so they will now be correctly set to NRG-Lockdown RestrictionLevel Restricted, instead of Unspecified. Additionally, fleet clusters within one of the undesired Unspecified states will be fixed on reconcile.
- Fix to prevent conflict between Open Service Mesh and AKS Admission Enforcer.
- Fix to improve response time and reduce long mc and agentpool operation latency.
- Behavioral Change
- All AKS managed namespaces now have a "kubernetes.azure.com/managedby:" AKS label.
- For exceptional cases, AKS now allows customer to update the requests and limits of VPA Updater and Recommender pods.
- Component Updates
- Microsoft Defender for Cloud publisher image has been updated to 1.0.68 (now distroless)
- Microsoft Defender for Cloud OldFileCleaner image has been updated to 1.4.68
- Azure Linux image has been updated to Azure Linux - 202310.26.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202310.26.0.