Xinyue Liu

icon indicating a website link https://cauchy221.github.io/

icon company Carnegie Mellon University icon location Pittsburgh, PA icon location MCDS @ CMU | RA @ CMU | DS (NLP) Intern @ Walmart | CS @ BUPT

Results 1 issues of Xinyue Liu

[Bug]: Claude-3.7 'thinking' parameter not support with litellm_proxy

1 comment

### What happened? I'm using `litellm_proxy` and custom `base_url`. The request looks like this: ```python response = litellm.completion( api_key=os.environ.get("LITELLM_API_KEY"), base_url=MY_URL, model='litellm_proxy/xxx/claude-3-7-sonnet-20250219', messages=xxx, temperature=0.0, thinking={ "type": "enabled", "budget_tokens": 200 } )...

bug
march 2025