Leo Barcellos

Results 30 comments of Leo Barcellos

I just reduced the chunk size from 100 to 25 on CampaignService:generateSendList, and also on CampaignEnqueueSendsJobs:handler. I've also added a pool config on database: `pool: { min: 2, max: 25...

Hmm, probably related, worker CPU Utilization was around 97% when it occurred. But it's still weird that this error happened. I also tried to check on event `email_failed` on the...

@pushchris Yes, some sends on the same blast campaign are going through normally and some are not, that is the weird part. Today we experienced same on 3 blasts from...

I just ran these commands on redis, hope this will prevent the second error mentioned. ``` SLAVEOF NO ONE REPLICAOF NO ONE ```

@pushchris I'm running on AWS ECS Fargate, I have a task with worker and a separated task with redis. The "slave" error went away with the commands I've mentioned earlier.....

Update: Redis issue was not related to memory issue. I just updated my deploy to a EC2 "monolith" (ui / api / worker / redis) with AWS RDS It's running...

By the way, I just checked this answer on stack overflow: https://stackoverflow.com/questions/55613789/how-to-fix-fatal-error-ineffective-mark-compacts-near-heap-limit-allocation-fa I just updated the env for the worker like this: `NODE_OPTIONS=--max_old_space_size=7580` Let's see if this helps.

Well, it keep happening, however I'm not experiencing deadlock issues or stuck campaigns anymore. I guess it was happening only on ECS FARGATE. ![Screenshot 2024-09-05 at 13 32 47](https://github.com/user-attachments/assets/c0face3f-1be9-4a14-b6ef-42289b3e3dcd) It's...

Yeah, I was at `debug` level to actually see what's going on. I returned it back to `error` log level, but it's still happening. I will drop the screenshot here,...

More info, memory of worker instance keep increasing.. that's why things start to fail at certain point: ![Screenshot 2024-09-12 at 14 06 41](https://github.com/user-attachments/assets/51a8286a-cfc1-4ca4-89b2-4b7ab3d86bf4) It starts like 50mb.. 70mb, and then...