Yarflam

Results 6 comments of Yarflam

I want to try ... but it's not working too.

I've found a faster solution: ```javascript vm.runInNewContext('code', { setTimeout: (callback, wait) => setTimeout(() => callback(), wait), clearTimeout: handle => clearTimeout(handle) }) ```

> Hey, we currently recommend a single tree for each document (we've tested for documents up to 400,000 tokens). For multiple documents, it's best to put another layer on top,...

Hi! I fixed this issue here: https://github.com/Yarflam/bitnet-test But the inference is unusable ... 🫠

> Thanks [@dawnmsg](https://github.com/dawnmsg) for your answer. In the paper [The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits](https://arxiv.org/pdf/2402.17764), specifically in Table 2, you demonstrated that your...