Anthony

I'm not sure exactly if this will help you. I found that the conda out of memory error could be (is believed to be) because of the package **pyopenssl**. I...

> Are you trying to lower the model to CoreML by passing `--coreml`? We're still actively working on enabling llama2 7b with CoreML. The xnnpack backend is ready for llama2...

@cccclai Yes, I'm trying to see an evaluation for the model on the Mac. I would like to put the model on my iPhone (iPhone 13 Pro) as well. I...

@YifanShenSZ I kept running into Disk Memory Issues on my Macbook Pro Even upto 30GB free space. I added the `--group_size 128 -qmode 8da4w -d fp32 --verbose --max_seq_length 512 -o...

Just tried `-kv --coreml --verbose --group_size 128 --max_seq_length 128` ran out of stroage, used 29gb trying to convert. I may try again later today after trying to free up some...

@cccclai The only thing that was confusing was it stating the "Required memory for activation in bytes: [0, 19002368]" I wasn't sure if the ./coreml_llama2.pte file was complete or not.