Running uw2 on a new project on GADI

[rcarluccio]

Hi Uw2 team,

I was wondering if you have any tips on how to run Underworld2 on a new project on Gadi.

I can currently run successfully my models if in the submission script I add:

#PBS -P q97 #PBS -l storage=gdata/m18

however, I do now need to use a different project dir and, if I use

#PBS -P dg01 #PBS -l storage=gdata/m18

I get the following /local/spool/pbs/mom_priv/jobs/55696606.gadi-pbs.SC: line 28: //2D_PP.55696606.gadi-pbs.log: Read-only file system,

and if I try

#PBS -P dg01 #PBS -lstorage=scratch/q97

The underworld package cannot be found. Would you have any tips on how to fix this?

Thank you, R.

[rcarluccio]

Please find below a copy of my working submission script for q97.

#PBS -P q97 #PBS -q normal #PBS -l walltime=00:05:00 #PBS -l mem=80GB #PBS -l jobfs=100GB #PBS -l ncpus=8 #PBS -l software=underworld #PBS -l wd #PBS -N uwtest #PBS -l storage=gdata/m18

MODELNAME="2D_PP" OUTPUTPATH=pwd SCRIPT="2D_PP.py"

export MODULEPATH=/g/data/m18/modulefiles:$MODULEPATH module load underworld/2.12

make blas serial

export OPENBLAS_NUM_THREADS=1

execution

mpiexec python3 ./$SCRIPT 1> $OUTPUTPATH/$MODELNAME.$PBS_JOBID.log 2> $OUTPUTPATH/$MODELNAME.$PBS_JOBID.err

[rcarluccio]

Resolved:

when the job is run under project q97, PBS makes /scratch/q97 automatically available to that job on the compute node. similarly, a job run under dg01 can see /scratch/dg01 but not /scratch/q97 path, and hence is ending up attempting to write to systems area and failing -dg01 has no storage space available on scratch.

in this case, you have to instruct PBS to make the above path available by modifying the storage directive:

#PBS -l storage=gdata/m18+scratch/q97 this and other PBS directives are documented here.

[julesghub]

Great work @rcarluccio!