Azure/AKS 2023-11-05

Release 2023-11-05

on GitHub

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

• Kubernetes 1.25 is being deprecated on January 14, 2024 and support will transition to our platform support policy.
• No new clusters can be created with Azure AD Integration (legacy). Existing AKS clusters with Azure Active Directory integration will keep working. All Azure AD Integration (legacy) AKS clusters will be migrated to AKS-managed Azure AD automatically starting from December 1st, 2023. We recommend updating your cluster with AKS-managed Azure AD before December 1st, 2023. This way you can manage the API server downtime during non-business hours.
• Starting January 2024, due to Gatekeeper Upstream removing validation for constraint template contents at create/update time, the Azure Policy Add-On will now no longer support this. The Azure Policy Add-On will report ‘InvalidConstraint/Template’ compliance reason code for detected errors after constraint template admission. This change does not impact other compliance reason codes. Customers are encouraged to continue to follow best practices when updating Azure Policy for Kubernetes definitions (i.e. Gator CLI.
• Windows containerd v1.7 will be the default container runtime for k8s v1.28+ on AKS Windows nodes. Windows Host Process (HPC) containers is GA in Windows containerd v1.7 and it has some breaking changes.
• Starting Kubernetes 1.29, the default cgroups implementation on Azure Linux AKS nodes will be cgroupsv2. Older versions of Java, .NET and NodeJS do not support memory querying v2 memory constraints and this will lead to out of memory (OOM) issues for workloads. Please test your applications for cgroupsv2 compliance, and read the FAQ for cgroupsv2.

Release notes

• Features
  • Kubernetes 1.28 is GA
  • Added kubernetes patch versions 1.25.15, 1.26.10, 1.27.7a
  • KEDA addon is GA
• Preview Features
  • Cluster network settings can be updated to enable Kubenet -> CNI Overlay migration - available in the CLI
• Bug Fixes
  • Incorporated fix for irqbalance #275 a node image upgrade from 202310.19.2 will resolve the unbalanced IRQs
  • Under some conditions it was possible to set max_surge=0 which may interfere with upgrades. Now max_surge must be > 0. See Customize node surge upgrade for more information about the setting.
  • Fixed an issue where PUT operations on managedClusters or agentPools see long latency in the overall operation due to an internal network issue.
  • PATCH operations were allowed on managedClusters in a non-terminal provisioningState. This could cause an eTag mismatch and inconsistent results or failures. PATCH operations will now be block for managedClusters in a non-terminal provisioningState.
• Behavioral Change
  • Updates to optimize the kube-reserved eviction thresholds (available in 1.28)[https://learn.microsoft.com/en-us/azure/aks/concepts-clusters-workloads#memory]
• Component Updates
  • Update the aks-app-routing-operator to version 0.0.7 which includes notable changes in version 0.0.6.
    • This update has 3 CVE fixes for the nginx ingress controller.
      • CVE-2023-5044
      • CVE-2022-4886
      • CVE-2023-5043
    • The following changes are also included:
      • The AJP protocol is no longer supported.
      • The whitelist-source-range annotation has been renamed to allowlist-source-range. Both are currently supported but it is recommended to move to the new annotation allowlist-source-range.
    • The custom-http-errors annotation now only supports errors between 400 and 599.
  • Azure Monitor Metrics November release to v.6.8.1
  • Update gatekeeper to v3.13.3 and policy addon 1.2.1
    • Azure Policy Changes
      • Introduce warn for policies, available in select upcoming built-in policy experiences
      • Show an exempt ComplianceReasonCode in the portal for exempt policies.
  • Update Azure Disk CSI driver version to v1.29.1 on AKS 1.28, to v1.28.4 on AKS 1.27, to v1.26.7 on AKS 1.26 and 1.25
  • Update Azure File CSI driver version to v1.29.1 on AKS 1.28, to v1.28.6 on AKS 1.27, to v1.26.9 on AKS 1.26 and 1.25
  • Update Azure Blob CSI driver version to v1.23.1 on AKS 1.28, to v1.22.3 on AKS 1.27, to v1.21.5 on AKS 1.26 and 1.25
  • Update cloud-controller-manager image to v1.27.11, v1.26.17, v1.25.22 (release notes)
  • Update to dropgz v0.0.15 to include azure-ipam v0.0.6
  • Azure Linux image has been updated to Azure Linux - 202311.07.0.
  • AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202311.07.0.