roligupt

spec.driver.configMaps doesnt work as specified in the user guide

6

I tried mounting the configmap to the driver and executor the way it is defined in the user guide and it doesnt work - https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/user-guide.md#mounting-configmaps driver: cores: 1 coreLimit: "1200m"...

I have some jobs running on spark operator but some of the jobs staying in "PENDING_RERUN" for several days, Is there any limit on how many jobs spark operator can...

Using remote shuffle service with Spark operator

2

@hiboyang Have you tried using remote shuffle service with spark operator? (spark on K8s operator)? I tested it with the client jar in my 'SparkApplication' image and it works as...

which branch should be used for building jar and image for remote shuffle service for K8 environment?

6

I see there are 2 branches K8 and rss-k8, which branch should be used for building jar and image for remote shuffle service for K8 environment?