xmoiduts
xmoiduts
Now SlickGPT will be able to keep the reply when receiving the abnormal API response.  Behavior example for fix commit: Receive [DONE] without stop sign: - not delete the...
Also ran into this issue recently.
It may not delete the unfinished API response but stuck somewhere. From my usage experience, the disappeared response will show eventually, but may not in the identical session, maybe in...
mitigated: when using older config files (like bs_roformer 12.9628.yaml), besides adding `sage_attention: true`, also needs to > set `flash_attn: false` > ====== to disable flash attention. Leaving **both** attentions enabled...