Yevhenii Hordashnyk

icon indicating a website link https://alpacked.io icon indicating an email [email protected]

icon company Alpacked icon location Kiev icon location CTO at Alpacked

Results 3 issues of Yevhenii Hordashnyk

[Bug]: CUDA device detection issue with KubeRay distributed inference for quantized models

6 comment

### Your current environment The output of `python collect_env.py` ```text Collecting environment information... PyTorch version: 2.3.0+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build...

bug

[Bug] Unable to launch vLLM with llama3.1:70B

22 comment

### Search before asking - [X] I searched the [issues](https://github.com/ray-project/kuberay/issues) and found no similar issues. ### KubeRay Component ray-operator, apiserver ### What happened + What you expected to happen I'm...

help-wanted

[BUG] Inability to search all documents or a group of documents with GraphRAG

2 comment

### Description Whenever you try to use all documents or a group of documents with GraphRAG, you get either ``` searching in doc_ids [] INFO:ktem.index.file.pipelines:Skip retrieval because of no selected...

bug