NewBornRustacean
NewBornRustacean
### Model description Hello! Thanks for this great work :) Previously, I implemented [mpnet-rs](https://github.com/NewBornRustacean/mpnet-rs) and found a related issue(feature request) #33 If there is no on-going work for the mpnet...
Good morning(or afternoon/ evening)! There is a methodology called **self speculative decoding** among the techniques to enhance the speed of LLM inference. Would it be possible to implement this feature...
# Add MatMulInteger ONNX operation to Burn Hello, Burn community! I'm trying to add `MatMulInteger` to `burn-import` ## Checklist - [ ] Confirmed that `run-checks all` script has been executed....
## Add muon optimizer to burn-optim #### What's new?: - Adds a new Muon optimizer implementation (crates/burn-optim/src/optim/muon.rs). - Implements Newton–Schulz orthogonalization, momentum integration, optional weight decay, and shape-based learning-rate adjustment...
What's up Burn community! I'd like to suggest to add a new optimizer *muon* ### Feature description Add the Muon optimizer to `burn-optim`. Muon (Momentum Orthogonalized by Newton-schulz) is a...