eventing icon indicating copy to clipboard operation
eventing copied to clipboard

SQS IntegrationSource repeat the message 5 times while the sink processing longger than 10 seconds

Open simsnow opened this issue 11 months ago • 4 comments

1.17

I create an IntegrationSource with sqs source and send a message to it

while the message processer finish in a short time, it is all right, while the message processer cost a long time, it while get 5 messages, period with 10 seconds

I can not find any where to config this behavior.

simsnow avatar Feb 28 '25 08:02 simsnow

this IntegrationSource have a 10 seconds retry,my trigger have configured a retry,this is confused.

so i want to make the IntegrationSource no retry,

but i can not find any config to make it work,(i have try to set "deleteAfterRead","visibilityTimeout","delay", not work)

simsnow avatar Mar 03 '25 02:03 simsnow

cc @christophd @matzew

pierDipi avatar Mar 07 '25 07:03 pierDipi

Hi,

are you sure that the very same message is produced multiple times by the SQS IntegrationSource? Also, are you sure that there is only a single message in the SQS queue and no other messages?

I expect the SQS IntegrationSource to only process messages that are actually available on the SQS queue. From my understanding there is no such retry mechanism on the SQS IntegrationSource for a single message. Each message on the SQS queue gets consumed and pushed as an event to the broker.

Maybe there is a SQS producer that hits a timeout and re-delivers the message to the SQS queue?

christophd avatar Mar 10 '25 07:03 christophd

This issue is stale because it has been open for 90 days with no activity. It will automatically close after 30 more days of inactivity. Reopen the issue with /reopen. Mark the issue as fresh by adding the comment /remove-lifecycle stale.

github-actions[bot] avatar Jun 09 '25 01:06 github-actions[bot]

/reopen

prashanthm10 avatar Jun 28 '25 05:06 prashanthm10

I am also facing the same problem. When I send couple of messages from sqs, somehow in between its resending the same message again and again

prashanthm10 avatar Jun 28 '25 05:06 prashanthm10

This issue is stale because it has been open for 90 days with no activity. It will automatically close after 30 more days of inactivity. Reopen the issue with /reopen. Mark the issue as fresh by adding the comment /remove-lifecycle stale.

github-actions[bot] avatar Sep 28 '25 01:09 github-actions[bot]