Troyanovsky
Results
2
comments of
Troyanovsky
First, the model size affects the resource use. 7B uses fewer resource than 13B. Then, the quantization method affects the resource use. 2Bit < 3Bit
This requires modifications to the "mention" feature, specifically parseMentions function, getFileOrFolderContent function, and extractTextFromFile function. If this new functionality is wanted, a new type of mention format should be added...