Ming li comments

Results 2 comments of


                                            Ming li

Implementation of Gemini API

Yes, any progress with ChatDev hook Gemini?

ValueError: The model's max seq len (4096) is larger than the maximum number of tokens that can be stored in KV cache (3664). Try increasing `gpu_memory_utilization` or decreasing `max_model_len` when initializing the engine.`

Same exception with `ValueError: The model's max seq len (2048) is larger than the maximum number of tokens that can be stored in KV cache (176). Try increasing `gpu_memory_utilization` or...