How to apply this methods to a new LMs without fine-tune?

[sev777]

Hi, In your paper, does the model edited in MEND methods must be fine-tuned? How to apply the MEND to the model without fine-tuning ? When I try to do this, the acc_train is always 0.

Thanks.

[himanshubeniwal]

+1 Just to clarify, is the MEND working on the fine-tuned model or just the pre-trained model?