Song Fuchang
Song Fuchang
Hello, I'm trying the free global memory query described here: https://github.com/intel/llvm/blob/sycl/sycl/doc/extensions/supported/sycl_ext_intel_device_info.md, which calls `zesMemoryGetState` under the hood. But I found that it always returns the total memory (`16225243136` bytes, which...
This PR fixes https://github.com/intel/intel-extension-for-pytorch/issues/522, using `ZES_ENABLE_SYSMAN` environment variable to make it work. It also adds a `torch.xpu.mem_get_info()` method which behaves the same as `torch.cuda.mem_get_info()`. Sadly it only works under root....
### Describe the issue Hello, I'm trying to make `accelerate` works with ipex and `device_map="auto"`, and in the source code `utils/modeling.py` of `accelerate`, it contains: ```python def get_max_memory(max_memory: Optional[Dict[Union[int, str],...
### Describe the bug Hello, I found that a simple `import matplotlib` or `import gradio` will make `is_xpu_available()` returns `False`: ``` (/opt/text-generation-webui/installer_files/env) pods@c636bef83b1f:~$ source /opt/intel/oneapi/setvars.sh :: initializing oneAPI environment ......
As https://github.com/intel/compute-runtime/issues/710, @Disty0 writes: > New 6.8.5, 6.8.6 and 6.6.27 LTS kernels are unable to run using the GPU. > It detects and tries to run on the GPU but...
### OpenVINO Version 2023.3 ### Operating System Fedora Silverblue 39 ### Device used for inference GPU ### Framework PyTorch ### Model used llava-hf/llava-1.5-7b-hf ### Issue description Hello, I'm trying to...
Hello, I'm trying ipex-llm 2.2.0b20240927 with pytorch ipex 2.3.110+xpu, and it failed with following error: ``` ERROR azarrot.backends.common:common.py:323 An error occurred when generating text Traceback (most recent call last): File...
## Description Add two arguments: `negative_prompt_ids` and `negative_prompt_attention_mask` to the `generate` method in `pipeline_parallel.py`. These two arguments are available since transformers 4.32.0. ### 1. Why the change? Hello, I'm using...
# What does this PR do? Hello, when I try assisted generation with optimum-intel and openvino, it complains about ``` AttributeError: 'OVModelForCausalLM' object has no attribute '_is_stateful'. Did you mean:...
### What problem does this PR solve? Hello, we are exposing some MCP endpoints on our backend service, and we want to use it in the `Generate` component for tool...