zio/zio-kafka v2.4.0

on GitHub

Noticeable Changes

1. Update kafka-clients from 3.4.1 to 3.5.0

2. Update Scala 2.12 to 2.12.8 and Scala 2.13 to 2.13.11

3. The optimistic prefetch mechanism, which we called "optimistic resume" in previous releases, introduced in v2.3.0 has been removed because of several performance issues.
   Instead, the prefetch mechanism, as present in v2.2 and earlier, has been put back and optimized by fixing a race condition in the enqueueing of internal messages to fetch more data and the next poll cycle starting.

   The prefetch amount is now controlled with a ConsumerSettings::maxPartitionQueueSize setting instead of the old ConsumerSettings::perPartitionChunkPrefetch setting.
   See ConsumerSettings::maxPartitionQueueSize documentation: #943

   The ConsumerSettings::enableOptimisticResume setting introduced in v2.3.2 has therefore been removed.

All Changes

• Document maxPartitionQueueSize setting @svroonland (#943)
• Review #803: Optimize partitionsToFetch computation @guizmaii (#942)
• Improve prefetch @svroonland (#803)
• Use less heap by calling offer directly @erikvanoosten (#940)
• Fix Consumer.consumeWith interface @guizmaii (#939)
• updating kafka-clients to version 3.5.0 @Casper12345 (#936)
• Revert "Optimistically resume partitions early" @svroonland (#932)
• [Internal] Only evaluate if (hasGroupId) once in getConsumerGroupMetadataIfAny @guizmaii (#931)
• Update scala-collection-compat to 2.11.0 @github-actions (#928)
• Revert "Update kafka-clients to 3.5.0 (#925)" @guizmaii (#927)
• Update embedded-kafka to 3.4.1 @github-actions (#926)
• Update kafka-clients to 3.5.0 @github-actions (#925)
• Update logback-classic to 1.3.8 @github-actions (#922)
• Update zio-sbt-ci, zio-sbt-ecosystem, ... to 0.4.0-alpha.12 @github-actions (#924)
• Avoid using ZIO.succeed when wrapping Kafka code @guizmaii (#921)
• [DX] Fix ConsumerSettings interface @guizmaii (#919)
• Fix project compilation @guizmaii (#916)
• Update zio-sbt-ci, zio-sbt-ecosystem, ... to 0.4.0-alpha.11 @github-actions (#912)
• Update README.md @zio-assistant (#915)
• Update scala-library to 2.12.18 @github-actions (#913)
• Update scala-library to 2.13.11 @github-actions (#914)
• Update zio-kafka, zio-kafka-testkit to 2.3.2 @github-actions (#911)

🌱 Dependency Updates

• Bump scala-steward-org/scala-steward-action from 2.54.0 to 2.56.0 @dependabot (#934)