kaito icon indicating copy to clipboard operation
kaito copied to clipboard

Examine the default inference parameters

Open Fei-Guo opened this issue 1 year ago • 0 comments

So far, the default inference parameters mainly come from the library defaults. We have found the default values were changed in the library without any justifications and we also found some of the changes lead to suboptimal inference output from language perspective. It would be ideal to design/use benchmarks to drive the changes of Kaito default values for inference.

Fei-Guo avatar Mar 22 '24 16:03 Fei-Guo