Rick Reddy

in LiteLLM (I use a config.yaml) you need to add the "drop_params: true" if you haven't done so. - model_name: azure-o1 litellm_params: model: azure/o1 api_base: api_key: api_version: "2024-12-01-preview" drop_params: true

We also use a proxy for all of our application, LiteLLM, to monitor team usage and provide routing and fallbacks. With the config.ts, I could provide a custom endpoint and...

Additional information, the failed library libnvidia-ml.so.1 exists in /usr/lib/x86_64-linux-gnu/ and I added that director to my $PATH but still receive same error.