docstrange icon indicating copy to clipboard operation
docstrange copied to clipboard

Feature Request: Allow selection of smaller Hugging Face models in docstrange local mode

Open sadhikariSteep opened this issue 6 months ago • 1 comments

When using docstrange in GPU local processing mode (via the DocumentExtractor), it appears to default to a specific large model nanonets/Nanonets-OCR-s.

For users with limited compute resources (e.g., less VRAM), running these larger 3B/4B parameter models locally can be slow.

For example, Nanonets provides models like nanonets/Nanonets-OCR2-1.5B-exp, which is significantly smaller and would be more accessible for local use on a wider range of hardware.

sadhikariSteep avatar Oct 23 '25 15:10 sadhikariSteep

PLG-207

linear[bot] avatar Oct 23 '25 15:10 linear[bot]