Sriram Ramanathan

'NoneType' object has no attribute 'find'

11

When submission is made using kg submit -u -p -c -m "" **'NoneType' object has no attribute 'find'** is thrown.

Is it possible to load 7b-it using quantization config

1

Newbie here. 7b-it model could be loaded in a low memory device via quantization config without using quant version of model using BitsAndBytes like below in huggingface's AutoModelForCausalLM . quantization_config...