Vladimir Nicolici
Vladimir Nicolici
It would be nice if the Json and Form serialization could support "snake case" in addition to "camel case". I frequently convert ruby apps to scala apps, and having "user_agent"...
Still happening, and it's very annoying. Using a Chromium based browser on Windows. Apparently a similar issue was fixed in 2021.
Same here, I'm on 1.9.4. Just typing a simple `hello`, or anything really, and it triggers it, each time I stop typing. Not sure what made it do that in...
I have a Windows Terminal that just crashed, and now I have no way to reconnect to the docker exec session it was running for the last 5 days, and...
I agree, this is extremely annoying, especially on mobile browsers that automatically refresh the page when you switch to another app. The entire layout and all the settings should be...
Both the `@csv` and `@tsv` filters are very strangely implemented in my opinion. What is a CSV file? An array of lines containing arrays of items. So a 2D array....
Misc. bug: The KV cache is sometimes truncated incorrectly when making v1/chat/completions API calls
OK, if there is anything else you want me to test to find the cause, I'm available.
Misc. bug: The KV cache is sometimes truncated incorrectly when making v1/chat/completions API calls
Two new lines ('\n\n'), between two sentences: ``` 4.12.294.383 D slot process_toke: id 0 | task 0 | n_decoded = 473, n_remaining = -1, next token: 271 ' ' ```
Misc. bug: The KV cache is sometimes truncated incorrectly when making v1/chat/completions API calls
I just repeated my last test. It was "skip" instead of "vivid" this time, but again followed by a dot, 16, then by 271 (two new lines). This time it...
Misc. bug: The KV cache is sometimes truncated incorrectly when making v1/chat/completions API calls
> If the latter, then the client would have to start storing the raw token ids along with the text and send the ids for the new requests. Does the...