sqlite-vec icon indicating copy to clipboard operation
sqlite-vec copied to clipboard

libsql is broken in bench and memory usage caused by distances

Open BeeBreeze opened this issue 1 year ago • 0 comments

Hi, i try using your benchmark tool bench.py, and find that the option libsql, i.e., bench_libsql, doesn't work. Could you please fix it? Thanks.

Also, it seems reasonless to keep sbe_query_knn_data->distances in vec_static_blob_entriesFilter, because keeping it will use a huge of memory. For instance, for about 1Million vectors and qsamle = 1k, the distances tables will take up about 4MB*1k = 4GB.

BeeBreeze avatar Aug 15 '24 09:08 BeeBreeze