Charles I Niswander II

Me too: `Traceback (most recent call last): File "/home/darf3/buddy/test.py", line 13, in main() File "/home/darf3/buddy/test.py", line 5, in main BlenderBot1b.init() File "/home/darf3/buddy/BlenderBot1b.py", line 325, in init model = GPTJForCausalLM.from_pretrained( File...

Also, I seem to get the same "NotImplementedError: Cannot copy out of meta tensor; no data!" error even when I roll back to 0.7.6. Is that expected? How can I...

@asafkar @felifri Have you tried with `low_cpu_mem_usage=False` argument in from_pretrained? But ultimately what I did that I think got it loading correctly (on 0.8.0) was to use CPU (and thus...

> > I can confirm that I'm able to replicate this. Interestingly, I'm finding that smaller OPT models work loading with meta tensor. It appears that models that are split...

Same problem here. Also still installs numpy 1.26.4.