vignesh

icon indicating a website link https://medium.com/@vi.ai

icon company Tapx icon location Banglore icon location I am a Deep Learning, Machine Learning Engineer. Fell free to check-out my repositories email:[email protected]

Results 8 comments of vignesh

Jupyter Notebook with Preprocess error

'Upsample' object has no attribute 'recompute_scale_factor' it's possible newer versions of PyTorch have additional argument requirements on certain modules like the Upsample one you show is causing issues. The current...

How PPO2 value function max-clip reduce variability?

I think you should consider a minimum for the clipper loss function

Converting to checkpoint.pd is not working

Can anybody help me with this

Converting to checkpoint.pd is not working

Ohh I see @chrisociepa Thank you

SiLU FFN

in LlaMA2 source code, they obtain 'X_V' with the origin 'x', instead of 'swish' its the same but in here the 'swish' function with beta =1 is nothing but SiLU...

Trading view recommend using color.rgb() insted of being transp..

> @vigneshyaadav27 Feel free to send a pull request with the fixes. Sure

[Bug]:Dimension mismatch error after switching to text-embedding-v4 (2048-dim): array at index 0 has size 2048 and array at index 1 has size 1024

This is due to the HNSW algorithm used for retrieval, which only supports a maximum of 2000 dimensions.

Error in Algorithm 1 of Flash Attention 2 paper

Oh boy !! I thought I was the one missing something I penned down the entire forward pass derivation and I did not understand why the Inverse over O is...