Mitch Pirtle

@mariovillamizar we're currently cranking on internal projects, but are staffing up and also adding dedicated product leadership to help manage feature requests such as this. Coming soon! That said we...

> Hello?... Is this library maintained? Just wanted to chime in here - it is, but we are currently working on internal projects and don't have a ton of capacity....

Solution offered by @behboud works for me as well - can someone do this, or do we need to submit a pull request?

@johnbean393 thanks for getting back so quickly! Downloaded and installed your update. So I upped GPU, switched to the 7B Qwen model, and set context length to 16384. My understanding...