llm-rs-python icon indicating copy to clipboard operation
llm-rs-python copied to clipboard
verified publisher icon LLukas22

Feature Request: Falcon 7B support

Open sidharthiimc opened this issue 2 years ago • 1 comments

I tried MPT end to end in script form. Works like charm.

Can you provide a similar support to new Falcon model?

sidharthiimc avatar Jun 04 '23 07:06 sidharthiimc

llm-rs-python is a wrapper around rustformers/llm. If the falcon support lands in rustformers/llm via https://github.com/rustformers/llm/issues/293 i'll include it in the wrapper.

LLukas22 avatar Jun 04 '23 08:06 LLukas22