Workers not picking up enqued jobs

Open raajeshnew opened this issue 10 years ago • 2 comments

urgent help requested

we use resque for batch uploads -- latest of symphony , doctrine and connected to elastic redis

we have created a default q with 10 worker threads. we split the uploads into a batch of 30 and if there are 10000 jobs so many batches need to run

Issue is when there are large job uploads the workers dont pick up some of the enqued jobs leaviong them in a state of limbo.

any thing in config needs to be done

Jul 21 '15 08:07 raajeshnew

I'm having a similar issue.

Redis gets the jobs, however the Worker does randomly pick them. I can't really understand what's happening.

Have you ever figured it out @raajeshnew ?

Dec 10 '15 11:12 IvoPereira

I'm also facing the same issue, I have 5 workers running. Still only one job is running at a time.

Sep 28 '17 09:09 jyothu