Mathieu Karamitros comments

Repositories
Issues
Comments

Results 2 comments of


                                            Mathieu Karamitros

Issue with model size after replacing BitLinear layer into a HF model (say Llama2-7b-chat)[BUG]

I had a quick look at this repo. In the current state of the code, it seems the binarized weights are still floats, which would explain your observation. Also it...

mamba-ssm complaining nvcc not found while cuda is installed

Same problem on windows, using venv. CUDA_HOME returns the expected path.