SimFG
SimFG
Can other caches work well? like sqlite cache
I'm not sure if it's because langchain has modified something that caused the cache not to work or for other reasons, because GPTCache implements the cache capability based on the...
@digi604 Is it possible for you to provide the completed demo code? It appears that the error is not caused by GPTCache.
@sebustam I don't quite understand what you mean. There are two classes, LangChainLLMs and LangChainChat, which inherit LLM and BaseChatModel respectively.
In the entire cache operation, it is not the db access that takes the most time, but the operation of embedding and other models. But for asynchrony, this is indeed...
Thank you for submitting your proposal. We appreciate your suggestion, which is already part of our plan. However, based on our latest research findings, we have identified that the majority...
@jiangbossB It's a great advice!
If you want to support streaming output, this should be supported in langchain, such as returning a generator