Quarterturn

4.9 kernels / debian stretch

1

Any hints on getting this working with a current 4.9 debian stretch kernel? When you wrote this we had dto/dtbo's but now it's all in uEnv.txt right? Also new stuff...

inconsistencies in memory allocation arguments depending on CPU use

1

### Describe the bug Command-line arguments used to specify memory are not consistent and documentation does not match. Examples: Specify just --gpu-memory - uses the values as 'GB' ``` $...

CUDA OOM with GPTQ-for-LLaMa

5

### Describe the bug when running the oobabooga fork of GPTQ-for-LLaMa, after about 28 replies a CUDA OOM exception is thrown. ``` torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate...

RuntimeError: GET was unable to find an engine to execute this computation

1

### System Info / 系統信息 declare -x CONDA_DEFAULT_ENV="cog" declare -x CONDA_EXE="/opt/conda/bin/conda" declare -x CONDA_PREFIX="/home/alex/.conda/envs/cog" declare -x CONDA_PREFIX_1="/opt/conda" declare -x CONDA_PROMPT_MODIFIER="(cog) " declare -x CONDA_PYTHON_EXE="/opt/conda/bin/python" declare -x CONDA_SHLVL="2" declare -x CUDA_HOME="/usr/local/cuda-12.5/"...

``` clang++ -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /Users/derp/miniconda3/envs/xtts2/include -arch arm64 -fPIC -O2 -isystem /Users/derp/miniconda3/envs/xtts2/include -arch arm64 -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/Users/derp/miniconda3/envs/xtts2/include/python3.10 -c crfsuite/swig/crfsuite.cpp -o build/temp.macosx-11.1-arm64-cpython-310/crfsuite/swig/crfsuite.o...