kafka icon indicating copy to clipboard operation
kafka copied to clipboard

KAFKA-14101: Improve documentation for consuming from embedded Kafka cluster topics in Connect integration testing framework

Open C0urante opened this issue 3 years ago • 0 comments

Jira

Depends on https://github.com/apache/kafka/pull/12429, which should implement a logical fix for KAFKA-14101. This follow-up PR is intended to help harden our integration tests against the mistakes that caused KAFKA-14101 by:

  1. Renaming EmbeddedKafkaCluster::consume to EmbeddedKafkaCluster::consumeAtLeast in order to clarify behavior and help distinguish between it and EmbeddedKafkaCluster::consumeAll.
  2. Adding a note to the Javadocs for EmbeddedKafkaCluster::consumeAtLeast warning about out-of-order consumption and data missing from topic partitions.

Though ready for review now, this PR should not be merged until https://github.com/apache/kafka/pull/12429 is merged.

C0urante avatar Jul 26 '22 20:07 C0urante