python-task-queue icon indicating copy to clipboard operation
python-task-queue copied to clipboard

feat(api): GCP Pub/Sub

Open nkemnitz opened this issue 5 years ago • 5 comments

PR adds support for Google's Pub/Sub queue

TODO: Add tests and maybe look into the missing features

nkemnitz avatar Mar 05 '20 04:03 nkemnitz

Ah, I seem to have missed this. Is this Google's primary task queue? Seems like they also have https://cloud.google.com/tasks/

william-silversmith avatar Jul 24 '20 04:07 william-silversmith

Seems like pubsub is more like what we want. https://cloud.google.com/tasks/docs/comp-pub-sub

william-silversmith avatar Jul 24 '20 05:07 william-silversmith

Hmm, I think Pub/Sub is more similar to SQS than Cloud Tasks, but there is no 100% perfect match between Pub/Sub, Cloud Tasks, SQS and SNS...

Notable differences between Pub/Sub and SQS I remember I ran into: Pub/Sub allows huge payloads (10 MB), but the maximum lease time limit is much shorter (10 minutes, iirc).

nkemnitz avatar Jul 24 '20 06:07 nkemnitz

I'm going to try to integrate this, but I'll probably have to do some radical surgery to this PR or open a new one due to the major refactoring that just happened.

william-silversmith avatar Jul 31 '20 09:07 william-silversmith

Would you still be interested in integrating this Nico? Happy to do it, just want to make sure there's interest.

william-silversmith avatar Jul 26 '21 20:07 william-silversmith