Benjamin Gonzalez

Results 2 comments of Benjamin Gonzalez

Same question here: I am trying this : ```python from paperqa import Settings, ask local_llm_config = dict( model_list= dict( model_name="llama3", litellm_params=dict( model="ollama/llama3.1", api_base="http://localhost:11434", temperature=0.1, frequency_penalty=1.5, max_tokens=512, ), ) ) answer...

I managed to make this work: ```python from paperqa import Settings, ask local_llm_config = { "model_list": [ { "model_name": "ollama/llama3.1", "litellm_params": { "model": "ollama/llama3.1", "api_base": "http://localhost:11434" } } ] }...