LLaMA-Pruning

LLaMA-Pruning copied to clipboard

Openai Whisper pruning

2

Hi I would like to prune openai's whisper, based on the llama-pruning. However, on the comments of this issue #1 , you mentioned that there is a huge error. How...

SangminAhn21

Benchmark for LLaMA pruning

2

If it is possible to give a benchmark of Pruned LLaMA.

dercaft

Results are unusable - what am I doing wrong?

6

Hi, I've tried the code "out of the box" and the output is very bad / unusable. I've tried all pruner_types with a ratio of 0.5, and I also tried...

SebastianApel