annotated-s4
annotated-s4 copied to clipboard
srush
Implementation of https://srush.github.io/annotated-s4
Hello @srush and @siddk Thank you for putting together this wonderful library and blog post. I have found them both to be incredibly helpful! A few months ago, when I...
Thanks for the great blog post, It was quite helpful for keeping track of what's happening in the paper. Currently in the section "Discrete-time SSM: The Recurrent Representation" in the...
Hello! My discussion group is admiring your blog post and we are wondering how to make it formatted so nicely. We are familiar in general with github.io. Did you have...
https://github.com/srush/annotated-s4/blob/1c0a53b0e3318f9327d44f0cdae64676c2e443d4/s4/dss.py#L446
https://github.com/srush/annotated-s4/blob/1c0a53b0e3318f9327d44f0cdae64676c2e443d4/s4/dss.py#L436
Nice work! I am facing trouble with running: python -m s4.train dataset=mnist layer=s4 train.epochs=100 train.bsz=128 model.d_model=128 model.layer.N=64 It gives: -3.1771252, -6.8962207, -4.7297306, -3.454745 , -5.095578 , -5.370283 , -4.856248 ,...
Hi! Great job! Can you help me with this issue? (ann1_s4) wsl@DESKTOP-CJL0ECN:/mnt/h/muhiddin/annotated-s4$ python -m s4.train dataset=quickdraw layer=s4 train.epochs=10 train.bsz=128 model.d_model=128 model.layer.N=64 2024-05-21 13:17:39.628139: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find...