parallel-consumer
parallel-consumer copied to clipboard
Missing message in consumption and eventually pauses all consmption
Version: PC 0.5.3.1
Some message at specific offset is never really consumed (skipped) and eventualy the consumption is stall.
After restarting the app, the missing message came back.
Looks like the message dispatcher may skip some messages under circumstances.
Here is an illustration on what happened: Actual messages in topic partition [1,2,3,4,5,6,7…] Actual messages received [1,2,3,5,6,7…] 4 is missing, and consumer Lag increases yet consumption still continues Eventually consumptions stops.
That's potentially the same issue as reported here: https://github.com/confluentinc/parallel-consumer/issues/857