TSL

NameError: name 'BNOptimizer' is not defined

4

在稀疏训练时，NameError: name 'BNOptimizer' is not defined，请问这个怎么解决

Hi, I am use your code to caculate the fvd of SVD model, I would like to know if the FVD obtained here needs to be divided by the number...

OS: Ubuntu20.04 64bit cbc -Wa,"--32" -Wl,"-melf_i386" hello.cb /usr/bin/ld: i386:x86-64 architecture of input file `/usr/lib32/crt1.o' is incompatible with i386 output /usr/bin/ld: i386:x86-64 architecture of input file `/usr/lib32/crti.o' is incompatible with i386...

RuntimeError: CUDA Setup failed despite GPU being available. Please run the following command to get more information:

3

### System Info False ===================================BUG REPORT=================================== /home/hadoop-platcv/.local/lib/python3.9/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: Welcome to bitsandbytes. For bug reports, please run python -m bitsandbytes warn(msg) ================================================================================ The following directories listed in your path were found...

How to use Tensorrt-LLM as backend

2

as describe in title

my calib dataset is c4 It seems that different samples have different lengths and cannot be directly torch.cat(samples, dim=0)。 llmc/llmc/data/dataset/base_dataset.py", line 89, in get_calib_dataset batch = torch.cat(samples, dim=0) RuntimeError: Sizes...

Where can I get the 10K tiktok style test split?

quantization of T5 faild. int8 model cost more inference time and memory.

2

### System Info A100-80G cuda12.1 bitsandbytes 0.43.2.dev0 diffusers 0.29.1 lion-pytorch 0.2.2 torch 2.0.1 torch-tb-profiler 0.4.3 torchvision 0.16.1+cu121 xformers 0.0.22 transformers 4.31.0 ### Reproduction # load code torch.backends.cuda.matmul.allow_tf32 = True torch.backends.cudnn.allow_tf32...