Dan Harris

Results 50 comments of Dan Harris

> > This PR would support this use case: apache/arrow-datafusion#1677 > > Thanks @thinkharderdev. I think it's better for the path to be self-described, like s3://hostname:port/xxx/... or hdfs://hostname:port/xxx/.... Then the...

@liukun4515 Are you running in standalone mode? It should initialize any registered executors from the backend if you are using etcd as the state backend but in standalone mode the...

> Since we need to update the available task slots for each executor in atomic, I think compare-and-swap operators can satisfy the needs perfectly. This is a bit problematic with...

In our project we've used the `ExecutorMetricsCollector` for this purpose and it seems to work relatively well. There is some additional plumbing needed since you have to have an rpc...

Nice! This is a great contribution.

@mijicd I don't see anything obviously wrong but not sure I understand where the schema decoder is being used at all. A known issue in ZIO Schema (https://github.com/zio/zio-schema/issues/168) is that...

> Ah sorry, I didn't list the actual decoder usage. It is used in [ArbitraryOutput](https://github.com/zio/zio-redis/blob/master/redis/src/main/scala/zio/redis/Output.scala#L208). Yeah, that seems right and it doesn't look like it's using the streaming decoder so...

I've seen the same thing locally but it seems to be sporadic so I haven't been able to investigate.