Animesh Trivedi

Results 9 comments of Animesh Trivedi

thanks for the pull request. As you might know that Crail has become an Apache Incubator project. And we are in the process of migrating and setting up the code...

@TeddyBear1314 Who says " it says GC will take care of it" ? What experiment are you doing? Also - This is a closed repo. If you want to ask...

No, i have not run into this error before. Under what conditions this error is triggered? Is this error deterministicly reproducible?

Hi Arvin 1. A buffer size represent the trade-off between I/O performance (the cost of moving data between DRAM (i.e. buffer cache) and I/O device) AND CPU cache hit/miss performance....

Small buffers reduce the CPU cache miss because the buffer can fit completely in the CPU cache. It will indeed reduce number of CPU stalls and time CPU has to...

We tried to avoid overheads associated with writing to disk when shuffling. So we mounted the tmpfs as the shuffling location to keep the shuffling data in DRAM (instead of...

Hi Laurence - unfortunately I recently switched jobs and did not get much time to work with the code. The plan is still to open source it, but it might...

https://github.com/databricks/spark-sql-perf/pull/115

rdma_listen uses the same port space as TCP. So I am suspecting there is already a program running or using the port number that you have specified. Check with `netstat...