openllmetry
openllmetry copied to clipboard
Open-source observability for your LLM application, based on OpenTelemetry
### Which component is this feature for? All Packages ### 🔖 Feature description Add support for `google-generativeai` - another package that Google provides for connecting to Gemini models. This should...
### Which component is this feature for? Ollama Instrumentation ### 🔖 Feature description Support tool calling in Ollama Instrumentation: https://github.com/ollama/ollama/blob/main/docs/api.md#chat-request-with-tools ### 🎤 Why is this feature needed ? - ###...
### Which component is this feature for? Anthropic Instrumentation ### 🔖 Feature description Support logging of prompt caching, including cached token usage: https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching#how-can-i-track-the-effectiveness-of-my-caching-strategy ### 🎤 Why is this feature needed...
### Which component is this feature for? OpenAI Instrumentation ### 🔖 Feature description Add support to OpenAI's recently announced structured outputs: https://openai.com/index/introducing-structured-outputs-in-the-api/ For example, support `refusal` responses ### 🎤 Why...
Screenshot of redis.search method span from traceloop:  - [X] I have added tests that cover my changes. - [X] If adding a new instrumentation or changing an existing one,...
- [ ] If adding a new instrumentation or changing an existing one, I've added screenshots from some observability platform showing the change. - [X] PR name follows conventional commits...
Related to #540 https://docs.llamaindex.ai/en/stable/module_guides/observability/callbacks/ Todo: - [ ] Add more tests - [ ] Check all previous instrumentors and move them to callbacks Checks: - [ ] I have added...
Fix TypeError: '<' not supported between instances of 'NoneType' and 'int' in embeddings_wrappers.py
This pull request fixes the issue where a TypeError occurs due to a comparison between NoneType and int The error was happening in the `_set_embeddings_metrics `function when recording token counts....
Bumps the gha group with 3 updates in the /packages/opentelemetry-instrumentation-ollama directory: [ollama](https://github.com/jmorganca/ollama-python), [flake8](https://github.com/pycqa/flake8) and [pytest](https://github.com/pytest-dev/pytest). Updates `ollama` from 0.2.1 to 0.3.1 Release notes Sourced from ollama's releases. v0.3.1 What's Changed...
Bumps the gha group with 5 updates in the /packages/opentelemetry-instrumentation-together directory: | Package | From | To | | --- | --- | --- | | [flake8](https://github.com/pycqa/flake8) | `7.0.0` |...