Mikhail Schrokikh comments

Repositories
Issues
Comments

Results 2 comments of


                                            Mikhail Schrokikh

Support Arch Linux for Outline Client

> We now have a CLI that should work on Arch Linux: https://github.com/Jigsaw-Code/outline-sdk/tree/main/x/examples/outline-cli Seems to be broken on arch again. This error appears on both `outline-cli` and systemctl's `outline_proxy_controller` daemon....

[Proposal] Memory efficient causal mask implementation

Is that a reason why `n_ctx` is limited (e.g. for llama3.1-8B model to 2048)? And is it why this particular 8B model doesn't fit into 32G in bfloat16?