Zhifei Zhang
Zhifei Zhang
Orgnization/Company: 360 Location: Beijing, China Contact: [email protected] Purpose/Scenario:distribute image to the kubernetes cluster
#### Same trouble langchain 0.0.352 openai 1.6.1 ``` File "/home/zhangzhifei/.local/lib/python3.10/site-packages/langchain_community/embeddings/localai.py", line 45, in _create_retry_decorator retry_if_exception_type(openai.error.Timeout) AttributeError: module 'openai' has no attribute 'error' ``` "Is this related to the Python version,...
“DenyAllRequests=true” have the same effect as removing lb‘s rs. I think it is more convenient to configure the downgrade policy in advance and open it by "switch" when needed
> what kind downgrade policy do you mean? sorry, i got it wrong. now , i understand
but, qps can‘t be set to 0, so how to "rejects some expansive requests, like list pods"
sorry，i forgot to close this issue.
/assign @dims @rphillips Please help me review this. thks
I've added an e2e test that separately evaluates batch creation of 10, 40, and 90 pods, measuring the time from the first pod's creation until the last one is distinguished....