AnyangAngus
AnyangAngus
meet same issue about loadding connection very slow. Did you slove this problem?
> > meet same issue about loadding connection very slow. Did you slove this problem? > > what problem are you facing? I don't think you are facing similar issue...
> > > > meet same issue about loadding connection very slow. Did you slove this problem? > > > > > > > > > what problem are you...
@lvhan028 Cool！ I see TurboMind can support llama-2-70b with GQA now. I would like to ask if there will be any support plans for LMDeploy to support Llama-2-7b and Llama-2-13b...
> Not yet, But I'm pretty sure this is something we want to support in the next 3-6 months. Stay tuned. @xiaofan-luan Can I follow this instruct to add hybird...
> Currently, the Doc Extractor node is not particularly good for scans. @crazywoola meet same issue , any suggestions?