EAGLE icon indicating copy to clipboard operation
EAGLE copied to clipboard

Why the bias of config in train scripts doesn't aligning at infererence?

Open Haodong-Lei-Ray opened this issue 1 year ago • 1 comments

When training, I found the bias doesn't align with the config. This file is in the EAGLE3/eagle/train/main.py. image I think if do that, the result will produce the bias in "fc" layer due to following the default. image Maybe you should edit it because I find the model_state_dict of your official model doesn't have the fc.bias.

Haodong-Lei-Ray avatar Oct 08 '24 15:10 Haodong-Lei-Ray

image I raise this question because I find Model follow this json.

Haodong-Lei-Ray avatar Oct 08 '24 15:10 Haodong-Lei-Ray