spark-perf

spark-perf copied to clipboard

Hi, There is any related paper to this work to better cite it? Thanks

felipeportella

TypeError : During Spark Test

1

i'm facing below error during execution [ahshan.md@xyz7030 bin]$ ./run Detected project directory: /home/ahshan.md/spark-perf Loading configuration from /home/ahshan.md/spark-perf/config/config.py Traceback (most recent call last): File "./../lib/sparkperf/main.py", line 40, in config = imp.load_source("config",...

ahshanmd

I run this test with default configs and jobs are running on 2 Spark nodes out of 5. How can I force running it on multiple nodes?

filanovskiy

Fix several 'NoSuchMethodError' during benchmark test in [Spark-2926](https://issues.apache.org/jira/browse/SPARK-2926)

xuanyuanking

state of the project?

2

From the commit history in master it has been almost a year since any activity, and some PRs have been un-merged for a very long time. Who are the main...

harschware

type error 

Minkyolyy

Excisting spark cluster - hadoop spark cluster is ideal one to run spark-perf?

2

I have a hadoop cluster with spark enabled on it. Can I run spark -perf on this cluster? Or should it be standalone cluster with spark on it?

athulase

when I use this spark workbench , In yran-client , only one executor runing everytime . Although I edit the testsuits.py by adding --num-executors and the cmd is as `/usr/hdp/2.5.0.0-1245/spark/bin/spark-submit...

wtx626

Input Data File Location

1

Hello, I am working on spark on yarn setup and running k-means algorithm. I want to know the location of the input data file generated by spark-perf or it is...

himanshurajput2

ahanagemini