mqyqlx
Results
1
issues of
mqyqlx
Hi, I found that the init method of parameters in pythia-6.9B model is inconsistent with the standard deviation of the [step0 checkpoint](https://huggingface.co/EleutherAI/pythia-6.9b/tree/step0). Table 6 in the [paper](https://arxiv.org/abs/2304.01373) shows that init-method...