LoRA fine-tuned CodeT5+ generating random final encoder outputs in inference time

[monilouise]

Hi,

I'm developing a bug detection system but realized the metrics are slightly random. I noticed that this line is returning different values for a saved model in inference time:

outputs = self.encoder.encoder(input_ids=input_ids, attention_mask=input_mask)

Considering the encoder is an instance of T5Stack.

Any clues about it?

Thanks in advance.