BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

可以解释preset_kernels目录下bitnet-lut-kernels-tl2.h文件中查表操作的实现吗?希望能从代码层面解释:1. 如何预处理生成一张表 2. 查表操作的实现

Open dujifeng opened this issue 1 year ago • 1 comments

dujifeng avatar Feb 18 '25 10:02 dujifeng

Please refer to this paper which firstly introduced LUT method for low bits model inference. https://arxiv.org/pdf/2407.00088

sd983527 avatar Apr 16 '25 05:04 sd983527