zcakzhuu comments

Repositories
Issues
Comments

Results 3 comments of


                                            zcakzhuu

Padding for training and inference

> @Reason-Wang as far as I am aware, padding should always be set on the left for inference. The idea is that you want to enforce a certain length for...

How to train using hard negative only?

> I think you'd need to modify > > [gritlm/gritlm/training/model.py](https://github.com/ContextualAI/gritlm/blob/724df95c0f760249d3581f82cd7ca7f9ad5191c0/gritlm/training/model.py#L41) > > Line 41 in [724df95](/ContextualAI/gritlm/commit/724df95c0f760249d3581f82cd7ca7f9ad5191c0) > > p_reps = self._dist_gather_tensor(p_reps) > to only gather hard negatives and only use...

How to train using hard negative only?

Hi @Muennighoff, Just checking in on my previous message regarding the code changes and the compute_similarity function. Would appreciate your thoughts when you get a chance. Let me know if...