llmperf icon indicating copy to clipboard operation
llmperf copied to clipboard
verified publisher icon ray-project

Fixed URL by adding version V1 prefix to OpenAI LLMPerf client

Open drelu opened this issue 2 years ago • 0 comments

  • Added v1 to URL
  • Example: https://x.x.x.x/v1/chat/completions
  • Complies now with OpenAI and vLLM OpenAI server
  • See https://platform.openai.com/docs/api-reference/authentication

drelu avatar Dec 26 '23 17:12 drelu