Rishub C R (Craftsman)

Yep adding new docs on an already indexed system. Yes we would need upsert and remove stuff. but for starters upsert would be great.

We cant regenerate a new parquet file and communities when I just added a file when I have 1000s of files preprocessed. Like in other vector DBs we need something...

I think let's do it. But i need more details on how ur doing the upsert after reading all the community details

Logs --------------------------------------------------------------------------- RuntimeError Traceback (most recent call last) Cell In[8], line 14 1 trainer = GRPOTrainer( 2 model=model, 3 tokenizer=tokenizer, # Note: 'processing_class' renamed to 'tokenizer' in newer versions (...)...