Devender Yadav
Devender Yadav
looks like it's `max_attempts`
Relevant discussion - https://issues.apache.org/jira/browse/SPARK-33349
@cmoad what's your k8 client and server version?
Hi @josecsotomorales! Are you able to use spark 3.3.0 without any issues?
@josecsotomorales how did you create the spark 3.3.0 image compatibility with gcr.io/spark-operator/spark:v3.1.1?
@apetresc yes from the master? Did you try building the image again?
@apetresc I'll try tomorrow. I am wondering if I can pull it from dockerhub directly. I am suggesting AWS to update sparkmagic version for EMR notebook. I just wanna try...
@itamarst can we update sparkmagic image to dockerhub. I don't know why but I am still getting errors in spark code compilation in docker compose build step.
@itamarst It's failing while building `Dockerfile.spark` in the below-mentioned step: ``` RUN mkdir -p /apps/build && \ cd /apps/build && \ git clone https://github.com/apache/spark.git spark && \ cd $SPARK_BUILD_PATH &&...
@itamarst I don't see any official image at dockerhub. On searching sparkmagic, I found https://hub.docker.com/r/heliumdatacommons/sparkmagic but this is updated year back and not sure if it is reliable. It's good...