Jeremy Bickel

If I understand the OP correctly, then I want to know this, too. How do I load a model from a non-standard location on my local drive? It's a GGUF,...

@RCGAI Here's what I came up with, which replaces llms/initialize.py. It demonstrates what I meant by 'patterns' in the first 4 functions defs. It works for single message completions, but...

Chat history and streaming seem like priorities, but there are other OpenAI-compatible endpoints supported by the text-generation-webui backend, which is hard to write all the time, so I just call...

The torch versions are mixed in the Dockerfile. According to ChatGPT (no guarantees - I did it manually and didn't test this file), the new Dockerfile should be: > FROM...

I got this using https://huggingface.co/MaziyarPanahi/DARE_TIES_13B-GGUF with the cpu only through ooba. Here's my output. 21:19:22-759106 INFO llama.cpp weights detected: "models/DARE_TIES_13B.Q6_K.gguf" llama_model_loader: loaded meta data with 25 key-value pairs and 419...

I'm getting these same errors with Ubuntu 22.04. I have zlib1g-dev installed.

If you tell me what qualities you are looking for in a repository, maybe I can help you find one. I'd be happy if you sent me a copy of...

Did you run server.py? If not, run it and switch to a new shell, then try the read command.

I don't know how to do pull requests. For now, here's the fix for this: Edit 'agentforge_cli.py' (ie. ''/home/example/dev/aivenv/lib/python3.10/site-packages/agentforge/utils/installer/agentforge_cli.py') Change line 49 From: copy_files_from_src_to_dest("agents", "agents/PredefinedAgents") To: copy_files_from_src_to_dest("agents/PredefinedAgents", "agents/PredefinedAgents")

I'm having this error in connection with these things. Notice 1) It's trying to build cpp_extension, and 2) it can't find "csrc/selective_scan/selective_scan.cpp". I don't know if you should keep noticing...