GenAIExamples
GenAIExamples copied to clipboard
Enable ChatQnA with vllm Arc support
Description
Enable ChatQnA with vllm inference on Intel ARC GPU
Issues
n/a
Type of change
List the type of change like below. Please delete options that are not relevant.
- [ ] Bug fix (non-breaking change which fixes an issue)
- [X] New feature (non-breaking change which adds new functionality)
- [ ] Breaking change (fix or feature that would break existing design and interface)
- [ ] Others (enhancement, documentation, validation, etc.)
Dependencies
https://github.com/opea-project/GenAIComps/pull/641
Tests
n/a