01
01 copied to clipboard
Inconsistent Model Specification Behavior
Title: Inconsistent Model Specification Behavior in Open Interpreter
Describe the bug
When attempting to specify a model using the --model flag in Open Interpreter, the system incorrectly handles the 'groq/' prefix by appending 'openai/' by default, which is confusing. There should be a clearer handling of prefixes.
To Reproduce Steps to reproduce the behavior:
- Open the terminal.
- Run the command
interpreter --api_base "https://api.groq.com/openai/v1" --model "groq/Mixtral-8x7b-32768". - Observe that the system appends 'openai/' to the model path instead of recognizing 'groq/'.
Expected behavior Correct handling of the provider. Groq should be supported without having to specify its api_base.
# This doesnt work, and is desired
interpreter --model "groq/llama3-8b-8192" --api_key "key_here"
# This doesnt work either
interpreter --api_base "https://api.groq.com/openai/v1" --model "groq/llama3-8b-8192" --api_key "key_here"
# This works
interpreter --api_base "https://api.groq.com/openai/v1" --model "llama3-8b-8192" --api_key "key_here"
Screenshots
Desktop (please complete the following information):
- OS: w11
- Python Version 3.12
Additional context