Vigith Maurice comments

Results 108 comments of


                                            Vigith Maurice

Autoscaling did not scale though targetBufferAvailability < 90

I am thinking whether we have to include the processing speed. The goal is to minimize tail latency. We need to simulate and see how to get to a smoother...

[WIP] doc: add docs for batchSize

@kohlisid can you add how this relates to UDF invocation?

Ability to start numaflow gRPC server locally

my current work around is ``` sudo mkdir /var/run/numaflow sudo chown vigith:staff /var/run/numaflow ```

Enable Opentelemetry protocol for metrics

I have assigned this to you

Accumulator: Join two "ordered" streams (streamsorter)

> Is it needed to do user defined sorting, or sorting by event time is good enough? If using customize sorting logic, is watermark still be able to be used...

Accumulator: Join two "ordered" streams (streamsorter)

> In that case, users also need to maintain the GC logic right? How to generalize it? We won't be generalizing that. They will have to store data in their...

expose batch-size and other pipeline specs are ENV vars

> > Is this for source? Are we able to leverage the parameters passed in `Read()` ? Can we get something at start time? It is not just for `Source`,...

switch e2e tests from go code to rust code (source, map, sink)

Please make sure we have both the tests going on for a while before we cut over.

SQS Missing Features

We do not have to support all features, just support top 2 and we can add as more asks come up.

compression on the wire and at rest

We didn't see a lot of improvements due to size reduction.