What will trigger this log when i using tfio.experimental.streaming.KafkaBatchIODataset api?

Open TTian-vivo opened this issue 4 years ago • 1 comments

condition: tensorflow: 2.5.0 tensorflow-io: 0.19.0 datasource: kafka 2.1.1 application scenario: online learning

When i running the task，i found the error message: E tensorflow_io/core/kernels/kafka_kernels.cc:45] EVENT_THROTTLE: 2ms by ip:port id ****

I want to know what will trigger this log ?

Jul 22 '21 09:07 TTian-vivo

@TTian-vivo I think this reference can help.

A snippet from that doc:

Kafka currently supports quotas by data volume. Clients that produce or fetch messages at a byte rate that exceeds their quota are throttled by delaying the response by an amount that brings the byte rate within the configured quota.

Jul 27 '21 16:07 kvignesh1420