OmniQuant icon indicating copy to clipboard operation
OmniQuant copied to clipboard

question about let

Open mxjmtxrm opened this issue 1 year ago • 0 comments

Hi, Why exclude down_proj when executing a let? like model.mlp.down_proj.temp_weight = model.mlp.down_proj.weight. I think the down_proj can be smoothed with up_proj, like smooth_fc_fc_temporary(model.mlp.up_proj,model.mlp.down_proj, model.down_smooth_scale, model.down_smooth_shift) Am I right?

mxjmtxrm avatar Jul 08 '24 08:07 mxjmtxrm