redpanda-data/connect v4.53.0

on GitHub

For installation instructions check out the getting started guide.

Added

• New google_drive_search processor. (@rockwotj)
• New google_drive_download processor. (@rockwotj)
• New google_drive_list_labels processor. (@rockwotj)
• Field use_enum_numbers added to protobuf processor. (@benwebber)
• Field tools added to cohere_chat processor. (@rockwotj)
• Field dimensions added to cohere_embeddings processor. (@rockwotj)
• Fields region, endpoint and credentials added to the dynamodb configuration section of the aws_kinesis input. (@jreyeshdez, @mihaitodor)
• Field transaction_isolation_level added to kafka_franz, ockam_kafka, redpanda, redpanda_common, and redpanda_migrator inputs. (@rockwotj)
• New cohere_rerank processor to rerank documents in RAG pipelines using Cohere. (@rockwotj)
• Fields request_timeout_overhead, conn_idle_timeout and start_offset added to the kafka_franz, ockam_kafka, redpanda, redpanda_common, and redpanda_migrator inputs. (@mihaitodor)
• Fields request_timeout_overhead and conn_idle_timeout added to the redpanda_migrator_offsets input and the kafka_franz, ockam_kafka, redpanda, redpanda_common, redpanda_migrator, and redpanda_migrator_offsets outputs. (@mihaitodor)

Changed

• Field start_from_oldest for the kafka_franz, ockam_kafka, redpanda, redpanda_common, and redpanda_migrator inputs is now deprecated in favour of start_offset. (@mihaitodor)
• Field topic_prefix added to the redpanda_migrator output. (@mihaitodor)
• Field offset_topic_prefix added to the redpanda_migrator_offsets output. (@mihaitodor)

The full change log can be found here.