David Greenberg
David Greenberg
Hello, do you think you could add ETC to this tool? It's really great!
Currently, we descend into quoted forms and attempt to instrument them. This breaks the quoted code and makes it uncompilable, as it refers to variables that don't exist when the...
Insert a try block inclusive of all but the last statement. Then if something is caught, log what lines were skipped and rethrow. Also need to instrument all try and...
This breaks syntax highlighting for every function that comes after this function: ``` (defn breakage [] ;break ) ``` This is because marginalia rewrites this to ``` (defn breakage []...
@tnachen pointed https://github.com/apache/spark/blob/3c0156899dc1ec1f7dfe6d7c8af47fa6dc7d00bf/core/src/main/scala/org/apache/spark/deploy/rest/RestSubmissionServer.scala out to me. We could implement this for Cook to simplify submitting prod jobs to Spark via Cook.
Besides setting the CPUs and Memory for each executor, we should be able to specify additional URIs or environment variables to retrieve for the executor, and the min threshold of...
We should have a table documenting all the properties that you can configure for the Cook spark binding.
We need to test against kerberized hadoop to ensure that this isn't needed--it was added as a kerberos support hack, but its time might've expired.
This will give us an idea of how long it should take to start some number of jobs, of various sizes. The motivation is to understand how long it _should_...