langfuse-python icon indicating copy to clipboard operation
langfuse-python copied to clipboard

[example] Add vLLM OpenAI-server example

Open dimaioksha opened this issue 1 year ago • 2 comments

I was struggling when I was trying to add Langfuse support inside OpenAI-compatible vLLM server. So here is an example what I found out and what worked for me and really helped for observability and tracking

dimaioksha avatar May 11 '24 11:05 dimaioksha

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar May 11 '24 11:05 CLAassistant

Hello @maxdeichmann. Can you make a review? If you need any clarifications, feel free to ask me, I would like to help

dimaioksha avatar May 11 '24 11:05 dimaioksha