kafka-python icon indicating copy to clipboard operation
kafka-python copied to clipboard

UnrecognizedBrokerVersion error for Kafka 2.6.2 running on AWS MSK

Open AndrewHannigan opened this issue 4 years ago • 1 comments

Running Kafka 2.6.2 on AWS MSK, and getting an UnrecognizedBrokerVersion error

Traceback (most recent call last):
  File "/home/ubuntu/repos/confluent-relay/confluent_relay.py", line 3, in <module>
    consumer = kafka.KafkaConsumer(
  File "/home/ubuntu/.local/lib/python3.8/site-packages/kafka/consumer/group.py", line 358, in __init__
    self._client = self.config['kafka_client'](metrics=self._metrics, **self.config)
  File "/home/ubuntu/.local/lib/python3.8/site-packages/kafka/client_async.py", line 244, in __init__
    self.config['api_version'] = self.check_version(timeout=check_timeout)
  File "/home/ubuntu/.local/lib/python3.8/site-packages/kafka/client_async.py", line 909, in check_version
    version = conn.check_version(timeout=remaining, strict=strict, topics=list(self.config['bootstrap_topics_filter']))
  File "/home/ubuntu/.local/lib/python3.8/site-packages/kafka/conn.py", line 1298, in check_version
    raise Errors.UnrecognizedBrokerVersion()
kafka.errors.UnrecognizedBrokerVersion: UnrecognizedBrokerVersion

AndrewHannigan avatar Nov 23 '21 02:11 AndrewHannigan

Resolved by specifying api version manually via the api_version argument to KafkaConsumer. Still puzzled why it failed to infer this automatically though. Suggesting use of api_version argument in the UnrecognizedBrokerVersion error message could be helpful.

AndrewHannigan avatar Nov 24 '21 04:11 AndrewHannigan