bigslice icon indicating copy to clipboard operation
bigslice copied to clipboard

Support for Rocks (SGE) backend

Open gnewton opened this issue 6 years ago • 1 comments

I am interested in how this could be extended to support other HPC backends. In particular, a Rocks-based system, a common bioinformatics HPC platform. I have very briefly looked (some) of the code. Do you have documentation / guidelines / pointers-to-relevant-source about how to implement something like this? I would be interested in working on this kind of extension.

Thanks, Glen

PS> Whoa! Sorry, I forgot to say how awesome this is! :-)

gnewton avatar Oct 04 '19 19:10 gnewton

Hi Glen, Bigslice is internally pretty well factored, so I think that should be doable.

In terms of porting to something like Rocks, the right thing to do is probably to add a Rocks backend to bigmachine, at which point Bigslice would "just work" (it relies only on the Bigmachine API for distribution and RPC).

mariusae avatar Oct 04 '19 22:10 mariusae