initialization-actions

initialization-actions copied to clipboard

not all worker nodes install modules correctly on 2.0-rocky8 clusters with GPU resource

2

Command: ``` gcloud dataproc clusters create $CLUSTER_NAME \ --region $GCS_REGION \ --zone XXX \ --project XXX \ --image-version=2.0-rocky8 \ --master-machine-type n1-standard-4 \ --num-workers $NUM_WORKERS \ --subnet default \ --worker-machine-type n1-standard-4...

nvliyuan

I would like to contribute a new initialization script that will change the yarn.nodemanager.log-dirs property in the yarn-site.xml to the local SSD mounts. Here are some features - 1. Update...

datasherlock

Preserving posix attributes of the connectors' jars

1

davidrabinowitz

[ERROR org.apache.spark.scheduler.AsyncEventQueue] On starting spark-shell in a cluster with custom 2.0-debian10 image

5

Starting a spark-shell results in `ERROR org.apache.spark.scheduler.AsyncEventQueue: Listener AppStatusListener threw an exception java.lang.NumberFormatException: For input string: "null"` **Summary of the steps** (Check next section to find exact steps) 1. Built...

SurajAralihalli

Tests done with single node, image 2.0-rocky8 clusters: 1. Dataproc cluster without init script: job is successful 2. Dataproc cluster with init script and job that does not specify gpu...

flacode

Initialization failed when action with `mlvm.sh`

1

### Command to create a GPU cluster ```bash $ gcloud dataproc clusters create cluster-b9b8-gpu \ --autoscaling-policy policy-d005-gpu \ --enable-component-gateway \ --region europe-west4 \ --zone europe-west4-a \ --master-machine-type n1-standard-8 \ --master-boot-disk-type...

mwbyeon

[hue] Enable Hive on 1.5 and 2.0 images

3

Hive is not enabled on hue 4.8.0 due wrong interpreter name - Includes test case to validate hive interpreter in hue config using [HUE REST API ](http://cloudera.github.io/hue/latest/developer/api/) Internal bug b/225389567

DKbyo

Added Trino init actions for Dataproc.

4

sametkaradag

We run the app timeline server on all masters, and point clients to $HOSTNAME to find the timeline server. This means that a) each Tez UI server only reads metrics...

karth295

Also adding an additional feature to enable SSL for internode communication in storm would be a great addition to the script. I already am working on such a script and...

varunika