auto-round icon indicating copy to clipboard operation
auto-round copied to clipboard

support for common hf multimodel

Open n1ck-guo opened this issue 1 year ago • 3 comments

n1ck-guo avatar Oct 11 '24 05:10 n1ck-guo

As discussed: 1 Configure the template using a file to eliminate the need for additional coding. 2 move the code from example to autoround 3 Refine the cache code in AutoRound to improve generalizability for new models with train_batch_size=1.

wenhuach21 avatar Oct 11 '24 06:10 wenhuach21

4 refine all the examples of vlm

wenhuach21 avatar Oct 11 '24 06:10 wenhuach21

5 also support it in auto_round cmd

wenhuach21 avatar Oct 11 '24 06:10 wenhuach21