llmperf
llmperf copied to clipboard
Fixed URL by adding version V1 prefix to OpenAI LLMPerf client
- Added v1 to URL
- Example: https://x.x.x.x/v1/chat/completions
- Complies now with OpenAI and vLLM OpenAI server
- See https://platform.openai.com/docs/api-reference/authentication