quartets

File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\generation\utils.py", line 772, in _get_logits_warper warpers.append(TemperatureLogitsWarper(generation_config.temperature)) File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\generation\logits_process.py", line 177, in __init__ raise ValueError(f"`temperature` has to be a strictly positive float, but is {temperature}") ValueError: `temperature` has to be...

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 2.00 MiB (GPU 0; 31.88 GiB total capacity; 30.82 GiB already allocated; 1.94 MiB free; 31.50 GiB reserved in total by PyTorch)...

ERROR:asyncio:Task exception was never retrieved future: Environment: Windows Server 2019 Sympton: The server started successfully, then after several rounds of interaction, it stopped responding, or picture upload took for ever.

### Describe the bug When loading c4ai-command-r-v01, I encountered the follow error messages: AttributeError: 'list' object has no attribute 'replace' But when loading c4ai-command-r-v01-4bit, there had been no error. Using...