Marko Henning

Results 4 issues of Marko Henning

Hello, I know this seems more of a debugging problem/problem on my side, but get the following error message when running my code, and it only appears when running it...

### Your current environment As I run vLLM in a docker container, I'll skip the `collect_env.py` step here. If you need the output of this in the docker container, I...

usage

### Your current environment The output of `python collect_env.py` ```text INFO 02-12 12:23:11 __init__.py:190] Automatically detected platform cuda. Collecting environment information... PyTorch version: 2.5.1+cu124 Is debug build: False CUDA used...

bug

# Pull Request Checklist ### Note to first-time contributors: Please open a discussion post in [Discussions](https://github.com/open-webui/open-webui/discussions) and describe your changes before submitting a pull request. **Before submitting, make sure you've...