neil0306

Results 15 comments of neil0306

same issue here. Also, I have Macbook Pro with M1 max (macOS version 12.5.1), is there anything I can do to help?

@opa334 Hi I tried 1.0.7 but it still said: "exploit fail". I do have a MacBook pro (M1 max) with macOS 12.5.1, also with Xcode installed (but I am not...

> I had the same issue, the following seemed to have fix it: > > ``` > sudo add-apt-repository "deb http://security.ubuntu.com/ubuntu xenial-security main" > sudo apt update > sudo apt...

same here, any suggestions?

Same here, I was using a single 3090 GPU, and met the OOM error with `bf16` and the `AttributeError: 'LlamaAttention' object has no attribute 'rope_theta'` with `fp16`. Edit: After monitoring...

I ran this model (with bf16) successfully on an L20 GPU (48GB), but it is really at risk of running out of memory (OOM). For fp16, it used about 26GB,...

> > > > I ran this model (with bf16) successfully on an L20 GPU (48GB), but it is really at risk of running out of memory (OOM). > >...