litellm icon indicating copy to clipboard operation
litellm copied to clipboard

[Feat] Update integration with Lunary

Open vincelwt opened this issue 2 years ago • 9 comments

Hi guys, This update the integration with Lunary (prev. LLMonitor) to use our official package which improves the reliability of the tracking and enables support for tracing when observing full agents. Tested and everything works with completions.

vincelwt avatar Feb 29 '24 06:02 vincelwt

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 30, 2024 4:22am
litellm-dashboard ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 30, 2024 4:22am

vercel[bot] avatar Feb 29 '24 06:02 vercel[bot]

Hi @krrishdholakia should be all good now :) Thanks!

vincelwt avatar Mar 01 '24 21:03 vincelwt

Hey @krrishdholakia - I've resolved the latest conflicts. Anything else to do to get this merged? Thanks

vincelwt avatar Mar 11 '24 03:03 vincelwt

@vincelwt looks like there's some unresolved merge conflicts. can you fix them and bump me? i'll merge it in

Screenshot 2024-03-16 at 7 15 03 PM

krrishdholakia avatar Mar 17 '24 02:03 krrishdholakia

bump @vincelwt

krrishdholakia avatar Mar 19 '24 01:03 krrishdholakia

Done @krrishdholakia

image

vincelwt avatar Mar 19 '24 03:03 vincelwt

@vincelwt did you test this to verify the cals get logged from litellm to lunary ? Can you send us a a screenshot of a working completion & embedding call logged

ishaan-jaff avatar Mar 21 '24 15:03 ishaan-jaff

Yes guys as I said in the PR message everything is tested and works. Lunary doesn't support embeddings so it ignores those at the backend level for now. @ishaan-jaff

image

vincelwt avatar Mar 21 '24 15:03 vincelwt

I've resolved the conflicts one more time but it'd be nice if you could merge this soon as there are more conflicts every time

vincelwt avatar Mar 21 '24 15:03 vincelwt

Would be great to get this merged 🙏

widike avatar Mar 28 '24 11:03 widike

Any updates on this? We really love litellm, and would be great to have this PR merged so the various bugs we face with litellm related to lunary are addressed. Thanks!

richloh avatar Mar 28 '24 14:03 richloh

LGTM! Just merged

krrishdholakia avatar Mar 30 '24 04:03 krrishdholakia

When starting litellm using the Docker image, it is not possible to access Lunary because the Python library for Lunary is not installed in the image.

Caixiaopig avatar Apr 04 '24 15:04 Caixiaopig