diegottt

Results 2 comments of diegottt

Infinite loop of "context shift"

The same infinite loop with neauralbeagle and localai 2.7.0

I try to run DeepSeek-Coder-V2-Lite-Instruct-GGUF but doesn't work

I disabled flash attention and try to change the batch size. Now I can load the model but I have this output: end_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_id_i