GenAIExamples icon indicating copy to clipboard operation
GenAIExamples copied to clipboard

Enable ChatQnA with vllm Arc support

Open gavinlichn opened this issue 1 year ago • 0 comments

Description

Enable ChatQnA with vllm inference on Intel ARC GPU

Issues

n/a

Type of change

List the type of change like below. Please delete options that are not relevant.

  • [ ] Bug fix (non-breaking change which fixes an issue)
  • [X] New feature (non-breaking change which adds new functionality)
  • [ ] Breaking change (fix or feature that would break existing design and interface)
  • [ ] Others (enhancement, documentation, validation, etc.)

Dependencies

https://github.com/opea-project/GenAIComps/pull/641

Tests

n/a

gavinlichn avatar Sep 09 '24 10:09 gavinlichn