bitsandbytes icon indicating copy to clipboard operation
bitsandbytes copied to clipboard

Can I quantize the tensors to other data type rather than 8bit tensor?

Open kaneyxx opened this issue 2 years ago • 0 comments

There's some quantization example here It showed that there is bnb.functional.quantize_fp4(x) But I didn't find it in documentations.

kaneyxx avatar Jun 15 '23 05:06 kaneyxx