SimplerLLM

SimplerLLM copied to clipboard

Compatible with the standard interface of OpenAI and multi-key support for the same interface: 1. more prams: baseurl，apikey, rate，enable; 2. Compatible with the standard interface of OpenAI: `/v1/chat/completions` and other;

lopins

Integration with Vector Databases

1

### I have added functions to integrate words into Vector bases. I have utilized chroma Database which is using all-MiniLM-L6-v2 model from the Sentence Transformers library. In **SimpleLLm/tools/vector_db.py** , I...

SaiNivedh26

Hi team, great library so far, I am wondering if the base_url parameter can be added to fully compatible with OpenAI, currently if it is not able to define this...

jacesca

Error installing SimplerLLM on Python 3.7.9

2

Hello, I have legacy projects and I'm trying to run SimplerLLM on Python 3.7 On PyPI meta I read Requires: Python >=3.6 but trying to install on Python 3.7.9 I...

maxrossi

**### pip install simplerllm** When I started installing it, it stopped multiple times with errors and then I had to install all these. 1. sudo apt install python3.13-dev 2. sudo...

TaimourNazar

Code from SimplerLLM.language.llm import LLM, LLMProvider llm_instance = LLM.create(provider=LLMProvider.OPENAI, model_name="gpt-4o") generated_text = llm_instance.generate_response(prompt="generate a sentence of 5 words") print(generated_text) /Users/xxxx/Code/10-AI-Projects-SImplerLLM/.venv/bin/python /Users/xxxx/Code/10-AI-Projects-SImplerLLM/0_start.py Traceback (most recent call last): File "/Users/xxxx/Code/10-AI-Projects-SImplerLLM/0_start.py", line 5,...

aramidetosin

added AzureOpenAI API call

2

Added AzureOpenAI API call functions that still uses existing dependencies (openai library) but allows usage of deployed Azure endpoints. Updated README.md with env template example. ## Summary by CodeRabbit ##...

joel-lzb

Installed and run simple example but facing this issue. **Code Snippet:** ``` from SimplerLLM.language.llm import LLM, LLMProvider hello = 'Hello' llm_instance = LLM.create(provider=LLMProvider.OPENAI, model_name="gpt-3.5-turbo") try: ai_response = llm_instance.generate_response(prompt=hello, max_tokens=4096) print("AI...

Muhammad-Ahsan-Rasheed

Support MCP

1

It looks like simplerllm doesn't support MCP, how to make it works with MCP, specially tools?

ryanhz