dhelgerson
dhelgerson
that works. also doesn't seem to have any issues. would it be possible to get the change int he gh or at least updating the commit it looks for?
any updates on this?
Found this while searching. How did this thread morph from talking about int8 to talking about fp8? Also, would it be possible leverage the gguf format for int8 quantization?
I was able to implement this with a one-liner as follows: `minimodem -rq 12000 | sudo socat PTY,raw,echo=0,link=/dev/ttyV1 - | minimodem -t 12000`
if run on k8s, I'd recommend setting up rffmpeg to distribute the encoding among workers