insufficient logging around `librdkafka` calls in the Kafka sink

Open bosconi opened this issue 1 year ago • 1 comments

Problem

Per https://github.com/MaterializeInc/incidents-and-escalations/issues/33 an MZ Kafka sink can get stuck reading the progress topic, in a way that might be related to KIP-890. However the cause is not clear from the logs that we have from occurrences of the issue.

Solution

It isn't clear that additional logging will identify the cause definitively, but it might, and it is possible to add additional logging in a way that won't impact performance, so we will do this, and see what is revealed next time this issue is observed.

insufficient logging around `librdkafka` calls in the Kafka sink

Problem

Solution

See also