Chaojian Shi

[P1] Can't reproduce the performance of Instruction following

1

Hello! I follow the #50 but can't reproduce the result of 1k data in the paper. I only got the win-rate of 0.4。The hyparameters and code are as following： ```...

[P1] Feeling confused about num_interventions and intervention_locations

4

Hello! I'm interested in the ReFT but have some questions. I want to intervene the 15th and 16th layer of the model, I use the following code: ``` TARGET_LAYER =...