zio/zio-kafka v2.3.2

on GitHub

Noticeable changes

1. Update Scala3 from 3.2.2 to 3.3.0
2. Update kafka-clients from 3.4.0 to 3.4.1
3. New helper functions in the testkit. See #893 for details.
4. We now have an Adopters list. Don't hesitate to put the name of your company there if you use zio-kafka! 🔥
5. New setting in ConsumerSettings: ConsumerSettings::enableOptimisticResume, true by default.

This new setting allows you to disable an internal optimisation we call "optimistic resume".
This optimisation has been introduced in v2.3.0.
Some users have reported very high latencies when this optimisation is enabled.
Disabling it seems to resolve this latency issue. (More details, see #903)

Our benchmarks also show that this optimisation can negatively impact performance if you use manual subscriptions (Subscription.manual(...)).
Therefore, If you use manual subscriptions, you might want to try to disable the "optimistic resume" optimisation and see if it improves the throughput and/or latency you observe in production.

Please, report any improvement or issue observed with and without this optimisation activated in our ZIO Discord channel so that we better learn about the positive and negative impacts this optimisation can have on real-world workloads.

Thanks! ❤️

All Changes

• Fix: Runloop thread name is always zio-kafka-runloop-thread-0 @guizmaii (#909)
• Update Scala3 to v3.3.0 @guizmaii (#873)
• Update kafka-clients to 3.4.1 @github-actions (#906)
• Update zio-streams, zio-test-sbt to 2.0.15 @github-actions (#905)
• Update kafka-clients to 3.4.1 @scala-steward (#908)
• Update zio, zio-streams, zio-test, ... to 2.0.15 @github-actions (#904)
• Extract all code refactoring from #587 @guizmaii (#901)
• [Testkit] Allow to customise broker properties @V-Lamp (#893)
• Document optimistic resume @erikvanoosten (#894)
• Update CI definition after merge of #896 @guizmaii (#897)
• Update README.md @zio-assistant (#896)
• Update zio-sbt-ci, zio-sbt-ecosystem, ... to 0.4.0-alpha.10 @github-actions (#895)
• Add new ConsumerSettings::enableOptimisticResume setting (true by default) to allow users to disable the "optimistic resume" optimisation && Write benchmarks where this optimisation is disabled @guizmaii (#889)
• Update sbt to 1.9.0 @github-actions (#891)
• Update zio-streams, zio-test-sbt to 2.0.14 @scala-steward (#888)
• Add Rocker as adopter @loathwine (#885)
• Update zio, zio-streams, zio-test, ... to 2.0.14 @github-actions (#886)
• Update scalafmt-core to 3.7.4 @github-actions (#887)
• Update jackson-databind to 2.15.2 @github-actions (#882)
• Update README.md @zio-assistant (#878)
• Update README.md @zio-assistant (#877)
• Update README @guizmaii (#876)
• docs: add KelkooGroup as adopter @gaeljw (#875)
• Initiate an "Adopters" list @guizmaii (#872)
• [Internal] Clean some code @guizmaii (#871)
• [Internal] Simplify code: Remove useless doPoll method @guizmaii (#870)
• [Internal] Extract Command from the Runloop file and rename it to RunloopCommand @guizmaii (#867)
• [Internal] Improve function name @guizmaii (#869)
• [Internal] Reduce timeouts in tests from 5 to 2 minutes @guizmaii (#866)
• [Internal] Fix tests logging configuration @guizmaii (#865)
• [Internal] Use SLF4J/Logback to configure logging in tests @guizmaii (#858)
• [Internal] Simplify Diagnostics interface @guizmaii (#861)
• Update zio-kafka version in README && Update zio-kafka-example project @guizmaii (#855)

🌱 Dependency Updates

• Bump scala-steward-org/scala-steward-action from 2.52.0 to 2.54.0 @dependabot (#874)