Disk-backed Persistent queue for channels in Raccoon

Open stym06 opened this issue 3 years ago • 3 comments

Summary Currently, Raccoon uses Channels for the intermediate processing of EventRequests, which are then forwarded to the message broker. But it does not solve the problem of loss of events that are there in the channel and could not get forwarded to Kafka when the server dies.

Proposed solution Implement some disk-backed queueing for intermediate persistence, similar to this project. https://github.com/jhunters/bigqueue

Nov 29 '22 12:11 stym06

we are already working on the event guarantee delivery proposal, will share the proposal soon, thanks.

Nov 29 '22 13:11 AkbaraliShaikh

Is there a running Design Doc for this? Would love to see the progress and the approach.

Nov 29 '22 18:11 stym06

Guys, is there any progress on this? Is there a design doc that I can look into?

Mar 01 '23 11:03 stym06