Samarendra Dash comments

Repositories
Issues
Comments

Results 4 comments of


                                            Samarendra Dash

Add longformer model

If this issue is open to contributions, I would like to pick this up.

Feature request: on-the-fly masking for pretraining (MLM + RTD)

I can take up the issue if approved.

Initializer for Penzai's Linear layer does not support `jax.nn.initializers`

Would it be possible to add a feature that wraps JAX initializers into Penzai initializers? Currently, Penzai only has two implemented initializers for neural networks. I believe the implementation would...

Initializer for Penzai's Linear layer does not support `jax.nn.initializers`

I am working on it! :)