Kyle Mistele
Kyle Mistele
Ridiculous that they don't support this.
Have you tested compatibility with the `server`? There probably needs to be a new prompt template since it's not compatible with the current ones AFAIK. Happy to dig into this...
Ah yes - it looks like they published the paper in April. Details [here](https://arxiv.org/html/2402.13753v1), PDF [here](https://arxiv.org/pdf/2402.13753v1.pdf)
The only Nvidia GPU that supports the `bfloat16` is the `A100` which I do not have access to. My v100 is an owned GPU not a rented/cloud one, so I...
I am planning to I just want to make sure I can use the tool locally first
is there no workaround for a v100?
yeah I can try it
Do you know if zephyr has the same problem @arnavgarg1 ?
fwiw they are working on it, Andrew posted a screenshot on twitter that included showed a pgvector index in drizzle, as well as other vector stuff - so it seems...
I would love to see this as well