XMaster96

- add datasets.window to inputs.py

I am trying to use a Categorical distributions inside of a function with JAX vmap. I also tested pmap and jit and both are working fine. Thanks for the help....

[Misc][Help]: Adding support for a Custom model with External MoE Routing

1

### Anything you want to discuss about vllm. I have a custom model that uses something really similar to MoE but instead of that routing being determined by the model...