Troyanovsky

Results 2 comments of Troyanovsky

First, the model size affects the resource use. 7B uses fewer resource than 13B. Then, the quantization method affects the resource use. 2Bit < 3Bit

This requires modifications to the "mention" feature, specifically parseMentions function, getFileOrFolderContent function, and extractTextFromFile function. If this new functionality is wanted, a new type of mention format should be added...