crunz icon indicating copy to clipboard operation
crunz copied to clipboard

Realtime output

Open esetnik opened this issue 1 year ago • 2 comments

Description
https://github.com/lavary/crunz/issues/152

I am moving this over from lavary/crunz because it's still a needed feature for this lib.

esetnik avatar Apr 19 '24 14:04 esetnik

What is your use case?

PabloKowalczyk avatar Jul 06 '24 11:07 PabloKowalczyk

We use cloudwatch for monitoring application logs coming from our docker processes. We have a large number of crunz jobs implemented that pull from sqs queues in a tight loop waiting for messages to become available on the queue. Because of the lack of realtime output we do not get any job logs for up to an hour because the job runs for a long time before terminating. It makes debugging any issues very difficult because we get no output. It also can lead to memory pressure-related issues since the entire output buffer is stored in memory and never flushed for the lifetime of the job.

esetnik avatar Jul 07 '24 14:07 esetnik