GoldUser32

some debug log from kafka DEBUG [BrokerToControllerChannelManager id=1001 name=heartbeat] Sending BROKER_HEARTBEAT request with header RequestHeader(apiKey=BROKER_HEARTBEAT, apiVersion=0, clientId=1001, correlationId=67, headerVersion=2) and timeout 4500 to node 1001: BrokerHeartbeatRequestData(brokerId=1001, brokerEpoch=5000018, currentMetadataOffset=5000104, wantFence=false, wantShutDown=false)...

snuba-transactions-consumer ``` snuba-transactions-consumer-1 | 2025-05-02 09:43:49,382 Initializing Snuba... snuba-transactions-consumer-1 | 2025-05-02 09:44:01,008 Snuba initialization took 11.627038423903286s snuba-transactions-consumer-1 | 2025-05-02 09:44:02,638 Initializing Snuba... snuba-transactions-consumer-1 | 2025-05-02 09:44:16,303 Snuba initialization took 13.667024563997984s...

I see that I have a lot of lag in the topic ingest-transactions ``` GROUP TOPIC CURRENT-OFFSET LOG-END-OFFSET LAG ingest-consumer ingest-transactions 442771558 443389135 617577 ``` and the container transactions-consumer keeps...

logs transactions-consumer ``` Running hooks in /etc/ca-certificates/update.d... transactions-consumer-1 | done. transactions-consumer-1 | 11:33:07 [INFO] arroyo.processing.processor: New partitions assigned: {Partition(topic=Topic(name='ingest-transactions'), index=0): 442771558} transactions-consumer-1 | 11:33:07 [INFO] arroyo.processing.processor: Member id: 'rdkafka-00401f69-5657-4163-b22b-b60d5e45c6d7' transactions-consumer-1...