sparklens
sparklens copied to clipboard
qubole
Qubole Sparklens tool for performance tuning Apache Spark
Hi, Any plans to release for Scala 2.12? Scala 2.13 and Spark 3 would be good to have support for. Thanks, Janek
Hi All, I have downloaded jar file as: wget https://repos.spark-packages.org/qubole/sparklens/0.3.0-s_2.11/sparklens-0.3.0-s_2.11.jar and I am trying to run sparklens as below, in **Spark 3.0.0 in aws EMR** [spark-submit --jars ./sparklens-0.3.0-s_2.11.jar --conf spark.network.timeout=100000...
According to https://mvnrepository.com/artifact/qubole/sparklens/0.3.2-s_2.11, the module should be available in SparkPackages, but we've seen intermittent download failures over the past week or so. For instance, right now, the package is not...
Hi Devs, I'm facing the issue where the stats from notebook is correct and the data generated using the sparklens json file is incorrect.Driver Wallclock is the metric that is...
Hello there! thanks for the tool, looks promising. nice thing that it works on historical events data! I tried that and got a 'Max memory which an executor could have...
The report gen logic using URL- sparklens.qubole.com/generate_report/request_generate_report is not working now. Is there any way we can generate the HTML report from code? I am able to get the report...
**Error** ``` py4j.protocol.Py4JJavaError: An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext. : java.lang.NoClassDefFoundError: scala/Product$class ``` **pyspark --version** ``` 22/02/03 18:11:23 WARN Utils: Your hostname, BLRETV-C02G23EY.local resolves to a loopback address: 127.0.0.1; using...
sparklens-0.3.2-s_2.11.jar spark version: 2.4.0 why the column maxTaskMem is 0.0KB, i try 2 different tasks, all shows like below: 
replaced https://dl.bintray.com/spark-packages/maven with https://repos.spark-packages.org to resolve ResolverException issue, as dl.bintray is sunset and forbidden.
