Maaalik

Results 3 comments of Maaalik

[QUESTION] Install MT-Telescope

@shawnkx, @anoopkunchukuttan, did you end up finding a way to install this application? Nothing works for me, unfortunately...

Issue Loading 4-bit and 8-bit language models: ValueError: `.to` is not supported for `4-bit` or `8-bit` models. Please use the model as it is, since the model has already been set to the correct devices and casted to the correct `dtype`.

I get the same error in Google Colab ("ValueError: `.to` is not supported for `4-bit` or `8-bit` models. Please use the model as it is, since the model has already...

Issue Loading 4-bit and 8-bit language models: ValueError: `.to` is not supported for `4-bit` or `8-bit` models. Please use the model as it is, since the model has already been set to the correct devices and casted to the correct `dtype`.

Works like a charm! Thank you very much, @younesbelkada!