Jeremy Bickel

icon indicating a website link aasmp.blogspot.com

icon location According to 1 Corinthians 15:1-8 and Romans 10:9-14a, believe 4 things and do 1 thing about Master Jesus to be saved from sin's deadly outcome.

Results 2 issues of Jeremy Bickel

Request: local text-generation-webui support

5 comment

Will you add support for oobabooga's text-generation-webui? An llm initialization for post requests and a few patterns might be sufficient. I've been trying to do it, but I've had to...

AutoModelForCausalLM.from_pretrained(.., gpu_layers=..) gives Windows Error 0xc000001d

1 comment

~~~~~~~~~~~~~~~~~~~~~~~ Any use of "gpu_layers" crashes it. ~~~~~~~~~~~~~~~~~~~~~~~ CUDA is working: (ct) C:\Users\Jeremy\Documents>python Python 3.11.6 (tags/v3.11.6:8b6ee5b, Oct 2 2023, 14:57:12) [MSC v.1935 64 bit (AMD64)] on win32 Type "help", "copyright",...