zio/zio-kafka v3.4.0

on GitHub

A new release bringing lots of small changes:

• The existing ZSink that merges Offsets (offsetBatches) has been renamed to the more descriptive collectOffsets.
  The old name is still available but is semi-deprecated.
• Introduction of a new ZSink collectOffsetBatches to merge OffsetBatches.
• Makes it possible to tweak or completely replace metric collection in both the Consumer and the Producer.
  Thanks to @sturmin for driving this effort!
• The documentation for committing and producing has been extended. In particular, it now has many tips on how to
  increase throughput. We now recommend aggregateAsyncWithin iso aggregateAsync to collect offsets.
• The zio-kafka tutorial was copied into this repository to make maintenance easier.
• Finally fixes (fingers crossed) the many flaky tests by limiting the number of concurrent admin operations to 1.
  Although we are not aware of Kafka applications that do this many admin operations, this is now also the default
  for the AdminClient.

This release has no less than 3 new contributors! Many thanks to @sturmin, @Jaksenc and @devchilles!

🚀 Changes

• Limit number of concurrent admin write operations by @erikvanoosten in #1667, #1696 and #1697
• Make metrics configurable by @sturmin and @erikvanoosten in #1664, #1673 and #1695
• Rename offsetBatches to collectOffsets, improve documentation by @erikvanoosten in #1681
• Rename the new collectBatches to collectOffsetBatches by @erikvanoosten in #1689
• Extend producer documentation by @erikvanoosten in #1679

🌱 Dependency updates

• Update zio, zio-streams, zio-test, ... to 2.1.25 by @zio-scala-steward[bot] in #1674
• Update zio, zio-streams, zio-test, ... to 2.1.26 by @zio-scala-steward[bot] in #1685

🔧 Maintenance

• Update README.md by @zio-assistant[bot] in #1662
• CI: Replace JDK 24 with JDK 25 by @guizmaii in #1659
• Update README.md by @zio-assistant[bot] in #1670
• Fix scalafmt corrupted class path issue by @erikvanoosten in #1687
• Correct tutorial link by @erikvanoosten in #1690
• Link zio-json serde tutorial by @Jaksenc in #1692
• Update zio-json to 0.9.2 in example code by @zio-scala-steward[bot] in #1693
• Replace one sleep with a Promise in SubscriptionsSpec by @devchilles in #1691
• Replace ConsumerSpec sleep with Promise coordination by @Jaksenc in #1694

🔧 Build dependency updates

• Update sbt-scalafix to 0.14.6 by @zio-scala-steward[bot] in #1660
• Update zio-sbt-ci, zio-sbt-ecosystem, ... to 0.5.0 by @zio-scala-steward[bot] in #1661
• Update sbt, scripted-plugin to 1.12.5 by @zio-scala-steward[bot] in #1663
• Update sbt, scripted-plugin to 1.12.6 by @zio-scala-steward[bot] in #1665
• Bump release-drafter/release-drafter from 6 to 7 by @dependabot[bot] in #1666
• Update sbt, scripted-plugin to 1.12.7 by @zio-scala-steward[bot] in #1668
• Update sbt, scripted-plugin to 1.12.8 by @zio-scala-steward[bot] in #1669
• Update sbt, scripted-plugin to 1.12.9 by @zio-scala-steward[bot] in #1676
• Update sbt, scripted-plugin to 1.12.10 by @zio-scala-steward[bot] in #1682
• Update sbt, scripted-plugin to 1.12.11 by @zio-scala-steward[bot] in #1683
• Update zio-sbt-ci, zio-sbt-ecosystem, ... to 0.5.1 by @zio-scala-steward[bot] in #1684
• Bump hmarr/auto-approve-action from 3.2.1 to 4.0.0 by @dependabot[bot] in #1680
• Update sbt-tpolecat to 0.5.4 by @zio-scala-steward[bot] in #1686

👨🏽‍💻 New Contributors

• @sturmin made their first contribution in #1664
• @Jaksenc made their first contribution in #1692
• @devchilles made their first contribution in #1691

Full Changelog: v3.3.0...v3.4.0