strimzi/strimzi-kafka-operator 0.42.0-rc1

on GitHub

⚠️ Important: Since 0.40 Strimzi supports only Kubernetes 1.23 and newer. Kubernetes versions 1.21 and 1.22 are no longer supported.

Main changes since 0.41.0

This release contains the following new features and improvements:

• Add support for Kafka 3.7.1
• The UseKRaft feature gate moves to GA stage and is permanently enabled without the possibility to disable it.
  To use KRaft (ZooKeeper-less Apache Kafka), you still need to use the strimzi.io/kraft: enabled annotation on the Kafka custom resources or migrate from an existing ZooKeeper-based cluster.
• Update the base image used by Strimzi containers from UBI8 to UBI9
• Add support for filename patterns when configuring trusted certificates
• Enhance KafkaBridge resource with consumer inactivity timeout and HTTP consumer/producer enablement.
• Add support for feature gates to User and Topic Operators
• Add support for setting publishNotReadyAddresses on services for listener types other than internal.
• Added support for configuring the quotas plugin with type strimzi or kafka in the Kafka custom resource.
  The Strimzi Quotas plugin version was updated to 0.3.1.

All changes can be found under the 0.42.0 milestone.

Watch out also for some notable changes, deprecations, and removals:

• The reconciliationIntervalSeconds configuration for the Topic and User Operators is deprecated, and will be removed when upgrading schemas to v1.
  Use reconciliationIntervalMs converting the value to milliseconds.
• Usage of Strimzi Quotas plugin version 0.2.0 is not supported, the plugin was updated to 0.3.1 and changed significantly.
  Additionally, from Strimzi 0.42.0 the plugin should be configured in .spec.kafka.quotas section - the configuration of the plugin inside .spec.kafka.config is ignored and should be removed.

Maven artifacts

To test the Maven artifacts that are part of this release, use the staging repository by including the following in your pom.xml:

  <repositories>
    <repository>
      <id>staging</id>
      <url>https://oss.sonatype.org/content/repositories/iostrimzi-1221/</url>
    </repository>
  </repositories>

Upgrading from Strimzi 0.41.0

See the documentation for upgrade instructions.

Upgrading from Strimzi 0.22 or earlier

Direct upgrade from Strimzi 0.22 or earlier is not supported anymore! You have to upgrade first to one of the previous versions of Strimzi. You will also need to convert the CRD resources. For more details, see the documentation.

Container images

The following container images are part of this release:

New Contributors

• @brandon-powers made their first contribution in #10095
• @urbandan made their first contribution in #10113
• @cht42 made their first contribution in #10228
• @ldpliu made their first contribution in #10199
• @daniel-axual made their first contribution in #10246
• @sebastiangaiser made their first contribution in #10263
• @hgranillo made their first contribution in #10275
• @Vince-Chenal made their first contribution in #10287

All changes

• Bump main branch to 0.42.0-SNAPSHOT by @scholzj in #10072
• Remove the unused Entity Operator TLS sidecar configuration from the installation files, Helm Chart and docs by @scholzj in #10077
• [DOC] Improve the host field description to make the default value more clear by @scholzj in #10073
• Clean some TLS sidecar leftovers from the Entity Operator clases by @scholzj in #10085
• Add missing parts to the dashboards + remove leftovers by @Frawless in #10088
• Add ContinueReconciliationOnManualRollingUpdateFailure to CHANGELOG and docs by @scholzj in #10089
• docs(node pools): updates from review of node pools content by @PaulRMellor in #10090
• Add Skillsoft to ADOPTERS.md by @brandon-powers in #10095
• docs(jbod): kraft: expands description for managing metadata storage by @PaulRMellor in #10083
• [system test] - fix testJbodMetadataLogRelocation for >= 3.7.0 Kafka … by @see-quick in #10093
• docs(security): updates content for securing kafka access by @PaulRMellor in #10071
• Improve the role change reversal and properly revert them by @scholzj in #10098
• docs(refactor): moves update content to separate section by @PaulRMellor in #10097
• Add Strimzi 0.41.0 to the main branch by @scholzj in #10100
• [performance] - TopicOperator capacity test case by @see-quick in #10050
• Make CC port configurable in KafkaRebalanceAssemblyOperator by @fvaleri in #10096
• Reorder the Azure CI Release pipeline to push Helm OCI at the end by @scholzj in #10112
• [ST] Changes to STs after release of 0.41.0 - upgrade/downgrade and default OLM version by @im-konge in #10109
• #8732 Enhance KafkaBridge resource with consumer inactivity timeout and HTTP consumer/producer parts enablement by @steffen-karlsson in #9820
• docs(kraft): makes the migration rollback situation clear by @PaulRMellor in #10111
• Promote the UseKRaft feature gate to GA by @scholzj in #10106
• docs(upgrade): extracts the client update step from the kafka upgrade procedure by @PaulRMellor in #10121
• Use UBI9 instead of UBI8 as a base image by @scholzj in #10126
• Add RF change ST tunings to make it more stable by @fvaleri in #10116
• Update Kaniko executor to 1.23.0 by @scholzj in #10132
• Fix Topic Operator metrics tests by @fvaleri in #10130
• Compute build revision in KafkaConnectAssemblyOperatorPodSetTest by @urbandan in #10113
• [Fix] correct bridge env vars names for consumer and producer enabled by @kornys in #10120
• Refactor handing and preparatin of trusted certificates by @scholzj in #10123
• docs(bridge): cleans up naming of kafka bridge by @PaulRMellor in #10144
• Extract Topic Operator's Cruise Control client by @fvaleri in #10092
• Expend feature gates support to all Strimzi operators by @scholzj in #10141
• [DOC] Regenerate the container images documentation snippet by @scholzj in #10151
• Fixed minor typo and indentation by @ppatierno in #10152
• Assume yes when using microdnf by @scholzj in #10157
• Update Vert.x and related dependencies by @scholzj in #10156
• Minor fixes in the Entity Operator model classes by @scholzj in #10150
• Add support for filename patterns when configuring trusted certificates by @scholzj in #10147
• Fix Topic Operator's reconciliationIntervalMs type by @fvaleri in #10158
• Update Fabric8 Kubernetes Client to 6.13 and the API specs derived from it by @scholzj in #10168
• Use pattern in trustedCertificates fields in examples by @scholzj in #10167
• Add Topic Operator's Cruise Control additional metrics by @fvaleri in #10160
• Include only broker nodes in the NodePort bootstrap address by @scholzj in #10170
• [DOC] Clarify that UseKRaft being GA does not mean you have to use KRaft by @scholzj in #10172
• ST: Add system test for tiered-storage with Aiven plugin by @Frawless in #10149
• Add publishNotReadyAddresses to GenericKafkaListenerConfiguration by @MichaelMorrisEst in #10178
• Updated bridge to 0.29.0 by @ppatierno in #10177
• Update JMX Exporter to 1.0.1 by @scholzj in #10184
• Deprecate reconciliationIntervalSeconds in favor of reconciliationIntervalMs by @fvaleri in #10175
• Update the GitHub action versions to use newer NodeJS version by @scholzj in #10193
• [DOC] add namespace to each kafkatopic operation commands by @tgib23 in #10194
• Introduce Helm Chart unit tests by @maciej-tatarski in #10192
• Run Helm chart unit tests on the Azure pipeline by @scholzj in #10195
• ST: Update Jeager Operator in systemtests to 1.57 by @Frawless in #10197
• Highlight migration doesn't work with one KRaft controller ephemeral storage by @ppatierno in #10190
• docs(refactor): updates to the oauth doc following review by @PaulRMellor in #10143
• [ST] Increase ZK replicas in TopicST by @im-konge in #10200
• Update the Kind test container and remove the Etcd version override and Maven overrides by @scholzj in #10203
• [ST] Fix TieredStorageST.testTieredStorageWithAivenPlugin by @kornys in #10205
• docs(tls): updates example config to show cert pattern property by @PaulRMellor in #10206
• docs(reconciliation): note on ContinueReconciliationOnManualRollingUpdateFailure by @PaulRMellor in #10207
• Update Kaniko to 1.23.1 by @scholzj in #10211
• Roll controller-only nodes when logging configuration changes by @scholzj in #10209
• [system test] Metrics collector test frame integration by @see-quick in #10191
• Update Sundrio dependency to 0.200.0 by @scholzj in #10219
• Update the Keycloak endpoint urls in examples and documentation by @mstruk in #10222
• Fixed warnings on potential final fields in Cruise Control related classes by @ppatierno in #10221
• [ST] Fix Namespace issue with TieredStorageST and add base image env variable to AZP by @im-konge in #10220
• Fix model warnings by @fvaleri in #10226
• Fix to_bytes.gawk for memory in terabytes by @cht42 in #10228
• Fix mirrormaker checkpoint_latency_ms metric labeling by @maciej-tatarski in #10223
• fix filter bug in dashboards by @ldpliu in #10199
• Make the name option forbidden for Kafka Connect connector configs by @scholzj in #10229
• Uncommented (and enabled by default) KRaft-related metrics in the example YAML by @ppatierno in #10240
• Raise warnings when broker IDs in listener configs don't match the actual broker IDs by @scholzj in #10230
• Refactor kafkarebalance handling methods by @ppatierno in #10232
• Improve response tracing and authorization error handling by @fvaleri in #10208
• Add BatchingTopicController refactoring (1/3): model classes by @fvaleri in #10196
• docs(kraft): introduces new section describing kraft by @PaulRMellor in #10171
• Added DEBUG logging on the Cruise Control API client by @ppatierno in #10239
• Auto-comment on invalid changes of released files by @scholzj in #10242
• Use mutable HashMap instead of immutable Map.of() in the API classes in places that should be editable by @scholzj in #10243
• Don't configure unused TLS sidecars in STs by @scholzj in #10249
• ST: Stabilize system tests on testing farm and other execution environments by @Frawless in #10166
• Add Quotas API to Kafka CR and upgrade Strimzi Quotas Plugin to 0.3.1 by @im-konge in #9895
• Fix the misleading log message when trying to roll pending pod by @tinaselenge in #10244
• Collect test coverage data from unit and integration tests by @scholzj in #10251
• Update logging of Kafka Connect when Connector operator is disabled by @scholzj in #10252
• Update assembly-drain-cleaner.adoc by @daniel-axual in #10246
• Add Cruise Control restart comment to the Topic Operator by @fvaleri in #10259
• ST: Evenly split components systemtest profile to more closely match with execution time for operators profile by @Frawless in #10255
• docs(refactor): moves pv recovery and FAQs to separate sections by @PaulRMellor in #10234
• Unify different logging annotations by @scholzj in #10261
• Add Hetzner to adopters file by @sebastiangaiser in #10263
• [DOC] Don't suggest that the tls flag in listener configuration has a default value by @scholzj in #10264
• ST: Skip TieredStorage tests on Microshift, fix race in AlternativeReconcileTriggersST by @Frawless in #10262
• Remove ClusterRole creation from the Cluster Operator by @scholzj in #10265
• Simplify certificate reloading for Deployment based components by @scholzj in #10269
• Address some build warnings with deprecations or unchecked casts by @scholzj in #10270
• [helm] add kafkanodepools to RBAC AggregateRoles by @hgranillo in #10275
• [system test] Update log for KafkaConnect when KafkaConnector is disa… by @see-quick in #10272
• Fix pushing of artifacts to Nexus by @scholzj in #10282
• Fix pushing of artifacts to Nexus - Once again by @scholzj in #10284
• Add support for Apache Kafka 3.7.1 by @scholzj in #10283
• Update Helm README.md with correct default memory limits by @akatona84 in #10286
• Add NodeIds in KafkaNodePool printer columns by @Vince-Chenal in #10287
• Remove the JBOD storage check from KafkaRebalanceAssemblyOperator by @scholzj in #10281
• Fixed the KafkaRebalance resource reconciliation getting stuck if CC pod is restarted during rebalance by @ShubhamRwt in #10224