Joo Donghyeon issues

Repositories
Issues
Comments

Results 3 issues of


                                            Joo Donghyeon

BERT 영상 예정일 질문입니다!

Attention is All You Need 실습코드 및 영상 잘 봤습니다! BERT에 대한 계획은 아직 없으신지 궁금합니다.

Only supports positive values.

It seems like this is just for positive inputs.

OPT-66B, unstructured sparsity gets wikitext perplexity 3404.0751953125

Hello, I used the scripts to prune the OPT-66B. (Unstructured, n_samples 128) Upon with, I get a wikitext perplexity of 3404, which is way off the metric given in the...