Rcorrector icon indicating copy to clipboard operation
Rcorrector copied to clipboard

Rcorrector speed optimization

Open sagnikbanerjee15 opened this issue 6 years ago • 3 comments

Hello,

I have been running Rcorrector and it has given me very good results. But unfortunately, it takes a very long time. Is there any settings which can help increase the speed.

Thank you.

sagnikbanerjee15 avatar Nov 20 '19 20:11 sagnikbanerjee15

That depends on the quality of the data. If there are more errors, it could take more time on searching the correct bases. You can try lower threshold for -maxcorK, so Rcorrector will not fix the reads with too many errors.

Another trick could be you can decompress the fastq file and gives more threads to Rcorrector. In my experience, when given more threads, the bottleneck becomes decompress/compress the fastq file.

mourisl avatar Nov 20 '19 23:11 mourisl

Great thanks!

sagnikbanerjee15 avatar Nov 21 '19 14:11 sagnikbanerjee15

Hi, Coming back to this issue, is it possible to overcome the bottleneck by instructing Jellyfish to open multiple files at once as detailed in the documentation? How to read multiple files at once
I can put a PR for this when I'll have a bit of time to play with it.

Cheers, Ido

IdoBar avatar Jun 10 '20 23:06 IdoBar