Job workflow

[tarekziade]

I know retools is low level, but since you have a jobs module with high level stuff, I'd love to add a high-level workflow for jobs:

A job would go through several queues

• the main queue
• a "running" queue
• a "successes" queue
• a "failures" queue

The two latter would keep the jobs unless purged.

[bbangert]

Sure, though currently when jobs are in process, they are moved to the worker's key in Redis to indicate they're being worked on. I think this sounds like a good idea, its also easier to do more operations atomically in Redis now with Lua scripting (a script runs in its entirety with no context switches, so all operations in it occur without interference).