Anuj Sahani comments

Results 6 comments of


                                            Anuj Sahani

NotImplementedError: Cannot copy out of meta tensor; no data!

> > @orangetin can you give more details regarding the exact cause of this error? > > Sure @wemoveon2 ! > > When loading the model using `device_map="auto"` on a...

NotImplementedError: Cannot copy out of meta tensor; no data!

> @anujsahani01 I can't import your Colab file. > > The error is caused by offloading model weights incorrectly. Refer to my previous comments on how to fix it: >...

ValueError: weight is on the meta device, we need a `value` to put in on cpu.

> I installed accelerate yesterday from GIT. I forgot to say. It all works OK in Google Colab. Google Colab has a 16 GB GPU and the model is loaded...

ValueError: weight is on the meta device, we need a `value` to put in on cpu.

> cc @younesbelkada since this is using 8bit-loading sir please help we out with this error in would be a great help. i am using 🤗tool " accelerate " to...

Using LoRA with CodeGen 2B mono

> same issue Using ``` target_modules= ["q_proj", "v_proj"],``` as target module worked for me but this is specified for bart model and not for CodeGen. You may have a look...

Bad request: The following `model_kwargs` are not used by the model: ['return_full_text', 'stop', 'watermark', 'stop_sequences'] (note: typos in the generate arguments will also show up in this list)

**Solution: Using `HuggingFaceHub` with LangChain** I found an effective way to use the `HuggingFaceHub` model with LangChain. Instead of the previous method, we can simplify and enhance the configuration as...