niceblue88

Results 5 comments of niceblue88

RuntimeError: cuDNN error: CUDNN_STATUS_INTERNAL_ERROR？

Yes still broken, at least for me. Pytorch 1.9, Cuda 11 and using Titan X in Windows 10. Benchmark = false works no problem reliably. Benchmark = true works for...

Split panes equally in size

I definitely second this suggestion, even though it looks like this original suggestion might be "waylaid" by now after a year or so. Use case here is for research, running...

[Bug]: "Cannot submit more than 5,461 embeddings at once. Please submit your embeddings in batches of size 5,461 or less." but on running *.delete*

Great reply, thank you for explaining so clearly. I thought it was exactly this, but the details you provide on SQLite3 is helpful. Digging into SQLite, any version higher than...

[Bug]: "Cannot submit more than 5,461 embeddings at once. Please submit your embeddings in batches of size 5,461 or less." but on running *.delete*

I know was considered, but the chunking could be included by default in Chroma (with negligible overhead if ids do not exceed max). Max 5 lines needed on the lib...

YaRN Support

I second this a lot. Being able to scale large context while keeping model vram use low is the most valuable part, almost all use cases scale in better usefulness...