BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

why two models here are same

Open RQiand opened this issue 9 months ago • 1 comments

Image

RQiand avatar Apr 28 '25 09:04 RQiand

it is a temporary change in the converting script, that we haven't tuned paras for tl kernels. In fact, for such small LLMs, i2_s should be faster than TL1 and TL2 so that we recommend just downloading the i2_s gguf model file https://huggingface.co/microsoft/bitnet-b1.58-2B-4T-gguf

sd983527 avatar Apr 29 '25 04:04 sd983527