M:kë comments

Repositories
Issues
Comments

Results 13 comments of


                                            M:kë

build_index using too much RAM during training and crashes

reducing to 7 400 000 embeddings succeeds. so probalby memory?

build_index using too much RAM during training and crashes

i think i found the cause. autofaiss is not respecting the current_max_memory field. I ran the CLI tool to build an index giving it the argument current_max_memory='24GB' the majority of...

build_index using too much RAM during training and crashes

what's happening during the 2nd stage of training? I don't think it's respecing the current_memory_available. I've set this to 24GB for example, but it would go up to 27ish GB...