Jize Cao

icon indicating an email [email protected]

icon company University of Washington icon location Seattle icon location UW CSE student. Research focus: language generation with RL, intersection between vision and language.

Results 3 comments of Jize Cao

RuntimeError: Function 'MmBackward' returned nan values in its 0th output.

The loss is a valid value. The anomaly detection shows the backtrace is ` queries = self._query_projection(queries) File "/home/caojize/anaconda3/envs/r2c/lib/python3.6/site-packages/torch/nn/modules/module.py", line 493, in __call__ result = self.forward(*input, **kwargs) File "/home/caojize/anaconda3/envs/r2c/lib/python3.6/site-packages/torch/nn/modules/linear.py", line...

RuntimeError: Function 'MmBackward' returned nan values in its 0th output.

What do you mean by "which queries tensor creates this issue?" ? It seems like the output of ``_query_projection`` doesn't have inf/nan value. I check the weight of that function,...

WC task bert accuracy is much lower than paper claimed

It's about one month and still no one reply ... The issue is relatively critical because I have tried different language models with current codebase and none of them has...