jgrn307
jgrn307
Related question: is there a way to resubmit expired jobs only (assuming they aren't queued), e.g. with longer walltimes?
Ah, it might be better to use sacct instead of squeue for job status with slurm -- sacct gives the status for all jobs past/queued/completed/failed/timed out/etc. From https://slurm.schedmd.com/sacct.html : JOB...
I can get you a sample output file from sacct if you let me know what parameters batchtools would need for getStatus() (besides the job status). One thing sacct will...
I think this would be great. You could create/submit the jobs, and then when all of the jobs are completed have a "merge" job trigger without having the "submitter" job...
By the way, I'm happy to help test this out on a SLURM machine. It seems a good first step would be to focus on batchtools combine-type functions.
Small correction with the above link -- when submitting the job via slurm, you will want to sbatch using the --parsable flag, e.g.: sbatch --parsable [blah blah] This will return...
Would it be possible to do a "simple" approach where we set a max array size parameter someplace, and have future.batchtools spread what would have been individual jobs across the...
Any updates on this? I was hoping to try the top up bottom down thing but I was hoping to use HACS to install it!
Any updates on this? Cheers!
Quick follow-up, I tried a "smaller" file of 100M points and it also crashed.