adirtha

Is inserting documents to an index one by one slower than inserting the documents when setting up the index?

2

I am using GPTFaissIndex as my index and am trying to insert about 6 million texts into it. I am initializing an empty GPTFaissIndex index first. The texts are first...

I am trying to use `GPTFaissIndex` for storing vectors for about 5 million texts. The vectors (which I am generating from a sentence-transformers) model are of 384 dimensions. If I...

update_collection shows 'Can't reach one of the workers: channel closed'

9

I uploaded around 36 million data to qdrant db after disabling the index like this: ``` client.recreate_collection( collection_name='my_collection', on_disk_payload=True, vectors_config=VectorParams(size=768, distance=Distance.DOT), optimizers_config=models.OptimizersConfigDiff( indexing_threshold=100000000, memmap_threshold=250000 ) ) ``` Once the data...

Hi. I came across your project. Looks interesting. I was thinking of running this project in python3 independently without using Dragnet. Is it possible? Thanks.