zio/zio-kafka v2.4.2

on GitHub

Noticeable Changes

• Update kafka-clients to 3.5.1 @github-actions (#994)

• Add note about partition reassignment with multiple subscriptions @svroonland (#1010)

• Document pollTimeout setting @erikvanoosten (#995)

• new ConsumerSettings::commitTimeout configuration. Default value: 15 seconds
  This timeout is a workaround for a deadlock that can occur when committing. Details #852

• Consumer:

  • new Consumer.fromJavaConsumer function to make a zio-kafka Consumer

• Producer:

  • new Producer.fromJavaProducer function to make a zio-kafka Producer
  • Fix signature of Producer#produceAll @vladimirkl (#993)
  • Enriched interface with the following additional new methods:

  trait Producer {
  
    def produce(
      record: ProducerRecord[Array[Byte], Array[Byte]]
    ): Task[RecordMetadata]
  
    def produceAsync(
      record: ProducerRecord[Array[Byte], Array[Byte]]
    ): Task[Task[RecordMetadata]]
  
    def produceChunk(
      records: Chunk[ProducerRecord[Array[Byte], Array[Byte]]]
    ): Task[Chunk[RecordMetadata]]
    
    def produceChunkAsync(
      records: Chunk[ProducerRecord[Array[Byte], Array[Byte]]]
    ): Task[Task[Chunk[RecordMetadata]]]
  
    def produceChunkAsyncWithFailures(
      records: Chunk[ProducerRecord[Array[Byte], Array[Byte]]]
    ): UIO[UIO[Chunk[Either[Throwable, RecordMetadata]]]]
  
  }

• Improvement of the SslHelper.validateEndpoint mechanism to make it as resilient as Kafka: If some Kafka bootstrap servers are down, that shouldn't affect the result of this function. Details #950

All Changes

• [Internal] Don't run benchmarks on forks @guizmaii (#989)
• Producer.produceChunkAsyncWithFailures @lukestephenson (#879)
• Update embedded-kafka to 3.5.1 @github-actions (#1012)
• Add note about partition reassignment with multiple subscriptions @svroonland (#1010)
• Create Consumer and Producer from existing apache kafka Consumer/Producer @svroonland (#1011)
• Document setting pollTimeout @erikvanoosten (#995)
• Update logback-classic to 1.4.9 @github-actions (#1008)
• Update logback-classic to 1.3.9 @github-actions (#1007)
• [Internal] Reorganize Consumer code @guizmaii (#999)
• Update scalafmt-core to 3.7.12 @github-actions (#1006)
• Update scalafmt-core to 3.7.11 @github-actions (#1002)
• Update sbt-tpolecat to 0.5.0 @github-actions (#1001)
• Update sbt to 1.9.3 @github-actions (#1000)
• [Internal] Re-organise Producer code @guizmaii (#998)
• Enrich Producer interface @guizmaii (#990)
• Fix signature of Producer#produceAll @vladimirkl (#993)
• Update kafka-clients to 3.5.1 @github-actions (#994)
• Fix: Runloop might be suspended when assigned with many partitions @yaarix (#986)
• Fix: Make the SslHelper.validateEndpoint as resilient as Kafka. If some Kafka bootstraps servers are down, that shouldn't affect the result of the validation @guizmaii (#950)
• Update scalafmt-core to 3.7.10 @github-actions (#985)
• Improve Scalafix configuration @guizmaii (#984)
• Implement default commit timeout @vladimirkl (#982)
• Prevent asInstanceOf @erikvanoosten (#963)
• Fix CI @guizmaii (#981)
• Update scalafmt-core to 3.7.9 @github-actions (#979)
• Update sbt-tpolecat to 0.4.4 @github-actions (#978)
• Update scalafmt-core to 3.7.8 @github-actions (#976)
• Update sbt to 1.9.2 @github-actions (#973)
• Update sbt-tpolecat to 0.4.3 @github-actions (#972)
• Update scalafmt-core to 3.7.7 @github-actions (#971)
• Fix scala 2.12 scaladoc @erikvanoosten (#969)
• Introduce FetchStrategy to allow custom fetch strategies @erikvanoosten (#953)
• Update scalafmt-core to 3.7.6 @github-actions (#968)
• Update zio-kafka, zio-kafka-testkit to 2.4.1 @github-actions (#967)
• Update README.md @zio-assistant (#965)
• Update README.md @zio-assistant (#964)
• Only calculate initial state once @erikvanoosten (#962)
• Document ConsumerSettings better @erikvanoosten (#961)

🌱 Dependency Updates

• Bump actions/setup-java from 3.11.0 to 3.12.0 @dependabot (#1005)
• Bump scala-steward-org/scala-steward-action from 2.59.0 to 2.61.0 @dependabot (#997)
• Bump benchmark-action/github-action-benchmark from 1.17.0 to 1.18.0 @dependabot (#974)
• Bump scala-steward-org/scala-steward-action from 2.56.0 to 2.59.0 @dependabot (#975)