topaz icon indicating copy to clipboard operation
topaz copied to clipboard

Alternatives to calling micrograph names as argument list in topaz extract

Open epkumpu opened this issue 1 year ago • 1 comments

Hi!

I am using topaz through cryoSPARC with topaz containerized. The container calls topaz extract in the following generic way:

singularity exec container.sif bash -c "..."

This runs into the system's maximum character limit for commands at around 500-600 micrographs in our setup, which means a lot of splitting micrographs. Without containerization we had a much more permissive limit of 6000-7000 micrographs (the max argument limit being the cap), but the current one is not really tolerable for larger datasets.

My question/request is: would it be possible to refer to micrographs in topaz extract in a way that does not need to open wildcards into long lists of arguments?

Cheers, EP

epkumpu avatar Jul 04 '24 10:07 epkumpu

Well, having made a more thorough search here, it seems something to address this is already being proposed here:

https://github.com/tbepler/topaz/pull/192

So consider this an upvote for that!

EP

epkumpu avatar Jul 04 '24 10:07 epkumpu

Fixed in https://github.com/tbepler/topaz/commit/134096829db98134d4e563e74d487e249112cc45

DarnellGranberry avatar Nov 12 '24 18:11 DarnellGranberry