Claude 2 Anthropic Support

Open bhctest123 opened this issue 2 years ago • 3 comments

It would be awesome to support claude 2! the 100k context window is amazing.

You could implement this and solve it across many LLMs: https://github.com/BerriAI/litellm

Aug 15 '23 04:08 bhctest123

I'm the maintainer of liteLLM - happy to make a PR and add an integration😊

Aug 15 '23 16:08 ishaan-jaff

At the moment, I am unable to see Claude being utilized to facilitate completions on Langchain. Nevertheless, Langchain does provide a Chat API as detailed here: https://python.langchain.com/docs/integrations/llms/. On the other hand, Claude's support for completions is available on Llama Index, so experimenting with that option could be worthwhile.

Aug 16 '23 09:08 codebanesr

ChatLiteLLM() is integrated into langchain and allows you to call all models using the OpenAI I/O interface https://python.langchain.com/docs/integrations/chat/litellm

Aug 16 '23 23:08 ishaan-jaff