rworker
rworker copied to clipboard
lecardozo
Celery worker for R tasks! Celery :left_right_arrow: R
As of now, there is no RabbitMQ client for R that can be used by `rworker`. For this reason, I started working on [rabbitr](https://github.com/lecardozo/rabbitr), a R client for RabbitMQ based...
Can't specify a username and have it applied. The code here does not look like it passes it on. https://github.com/lecardozo/rworker/blob/master/R/redis_queue.R#L38-L67
Currently, `rworker` consumer only listens for one specific queue, which is defined on the object creation via the `name` argument: ```R consumer
Somewhere in the way the worker tasks are called, their output is captured, buffered, and then written. This has three consequences: 1. This only seems to capture `stdout`. `stderr` seems...
Currently, each instance seems to grab from the queue all there is, then creates its own internal queue with this. When multiple parallel rworker instances read from the same queue,...
This would be useful for logging. Currently, when we have multiple tasks running concurrently and logging to the same log stream (like in AWS ECS), they don't have an easy...