automq
automq copied to clipboard
It is unable to consume messages after the only controller restarts
In server.log, log entries are repeatedly printed:
[2023-10-10 08:40:46,626] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Discovered group coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,626] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Request joining group due to: rebalance failed due to 'This is not the correct coordinator.' (NotCoordinatorException) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,626] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,628] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Successfully joined group with generation Generation{generationId=6955, memberId='AutoBalancerControllerConsumer-consumer--7526509455016652825-c6168832-f5f4-4b93-9ba6-e47f20188b91', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,628] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Finished assignment for group at generation 6955: {AutoBalancerControllerConsumer-consumer--7526509455016652825-c6168832-f5f4-4b93-9ba6-e47f20188b91=Assignment(partitions=[__auto_balancer_metrics-0])} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,629] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] SyncGroup failed: This is not the correct coordinator. Marking coordinator unknown. Sent generation was Generation{generationId=6955, memberId='AutoBalancerControllerConsumer-consumer--7526509455016652825-c6168832-f5f4-4b93-9ba6-e47f20188b91', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,629] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Group coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) is unavailable or invalid due to cause: error response NOT_COORDINATOR. isDisconnected: false. Rediscovery will be attempted. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,629] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Requesting disconnect from last known coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,629] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Client requested disconnect from node 2147483643 (org.apache.kafka.clients.NetworkClient)
[2023-10-10 08:40:46,630] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Discovered group coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,630] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Group coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) is unavailable or invalid due to cause: coordinator unavailable. isDisconnected: false. Rediscovery will be attempted. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,630] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Requesting disconnect from last known coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,735] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Discovered group coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,735] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Request joining group due to: rebalance failed due to 'This is not the correct coordinator.' (NotCoordinatorException) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,735] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] (Re-)joining group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,737] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Successfully joined group with generation Generation{generationId=6956, memberId='AutoBalancerControllerConsumer-consumer--7526509455016652825-c6168832-f5f4-4b93-9ba6-e47f20188b91', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,737] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Finished assignment for group at generation 6956: {AutoBalancerControllerConsumer-consumer--7526509455016652825-c6168832-f5f4-4b93-9ba6-e47f20188b91=Assignment(partitions=[__auto_balancer_metrics-0])} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,737] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] SyncGroup failed: This is not the correct coordinator. Marking coordinator unknown. Sent generation was Generation{generationId=6956, memberId='AutoBalancerControllerConsumer-consumer--7526509455016652825-c6168832-f5f4-4b93-9ba6-e47f20188b91', protocol='range'} (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,737] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Group coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) is unavailable or invalid due to cause: error response NOT_COORDINATOR. isDisconnected: false. Rediscovery will be attempted. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,737] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Requesting disconnect from last known coordinator 10.0.1.142:9092 (id: 2147483643 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2023-10-10 08:40:46,737] INFO [Consumer clientId=AutoBalancerControllerConsumer-consumer--7526509455016652825, groupId=AutoBalancerControllerConsumerGroup-group--7526509455016652825] Client requested disconnect from node 2147483643 (org.apache.kafka.clients.NetworkClient)