Tommy

RuntimeError: CUDA error: an illegal memory access was encountered

11

``` RuntimeError Traceback (most recent call last) Cell In[3], line 4 2 config.model_path = model_path 3 config.max_seq_len = 2048 ----> 4 model = ExLlama(config) 5 cache = ExLlamaCache(model) 6 tokenizer...