Robert Paulson
Robert Paulson
If you are willing to spend 20-30 $ you can utilize the large token window of Claude 3 and use https://github.com/mufeedvh/code2prompt to upload the entire code base into claude 3...
ok, that makes sense. However it gives another error: Encountered an exception, AIlice is exiting: 'formatter' File "/home/user/AIlice/ailice/AIliceMain.py", line 126, in main mainLoop(**kwargs) File "/home/user/AIlice/ailice/AIliceMain.py", line 91, in mainLoop llmPool.Init([modelID])...
CUDA_VISIBLE_DEVICES=0 ollama run doesn't work for me on debian. It distributes almost uniform over all CUDA GPUs. Can you post in README how to specify CUDA devices? Its not clear...
In this case there might be a bug. The system does not change its GPU usage for me, it will always use all GPUs even I do something like 'CUDA_VISIBLE_DEVICES=-1...
user@debian-ai:~$ sudo systemctl stop ollama [sudo] password for user: user@debian-ai:~$ nvidia-smi -L GPU 0: Tesla M40 24GB (UUID: GPU-81c595e9-30fa-224b-5e8e-8c32c13d7782) GPU 1: Tesla M40 24GB (UUID: GPU-6e247760-9d88-5fa3-1849-0f693b2aaf51) GPU 2: Tesla M40...
Ah right. Loading the model indeed only used the specified GPUs. Hence this approach solved it for me.
Hmm. I have no idea. My initial intuition would be that maybe $2$ is special as a prime number, but IDK. '2'-torsion essentially means P+P=0, so its the group of...
Cambridge Advanced Learner's Dictionary (CALD) states that "either-or describes a situation in which there is a choice between two different plans of action, but both together are not possible". https://math.stackexchange.com/questions/1906242/does-either-or-means-xor-or-or