StereoSet

StereoSet copied to clipboard

Error evaluating a new model

4

After generating the predictions file and running evaluation.py i got this message: File "evaluation.py", line 90, in count if (self.id2score[pro_id] > self.id2score[anti_id]): KeyError: '6b56153532fa360d37c25e918546f571'

Felipehonorato1

I am a beginner, I have simply run your script, but it seems that no model has been downloaded, giving me the feeling of just repeating the record. Also, I...

VelikayaScarlet

webstite down models arent avaliable

1

--2023-08-02 03:30:30-- http://moinnadeem.com/stereoset/pretrained_models/GPT2Model_gpt2_0.0005.pth Resolving moinnadeem.com (moinnadeem.com)... 143.110.228.1 Connecting to moinnadeem.com (moinnadeem.com)|143.110.228.1|:80... failed: Connection refused. --2023-08-02 03:30:31-- http://moinnadeem.com/stereoset/pretrained_models/GPT2Model_gpt2-medium_0.0005.pth Resolving moinnadeem.com (moinnadeem.com)... 143.110.228.1 Connecting to moinnadeem.com (moinnadeem.com)|143.110.228.1|:80... failed: Connection refused. --2023-08-02 03:30:31--...

nimnim111

Bumps [certifi](https://github.com/certifi/python-certifi) from 2019.11.28 to 2022.12.7. Commits 9e9e840 2022.12.07 b81bdb2 2022.09.24 939a28f 2022.09.14 aca828a 2022.06.15.2 de0eae1 Only use importlib.resources's new files() / Traversable API on Python ≥3.11 ... b8eb5e9 2022.06.15.1...

dependabot[bot]

Bumps [joblib](https://github.com/joblib/joblib) from 0.14.1 to 1.2.0. Changelog Sourced from joblib's changelog. Release 1.2.0 Fix a security issue where eval(pre_dispatch) could potentially run arbitrary code. Now only basic numerics are supported....

dependabot[bot]

Bumps [numpy](https://github.com/numpy/numpy) from 1.18.2 to 1.22.0. Release notes Sourced from numpy's releases. v1.22.0 NumPy 1.22.0 Release Notes NumPy 1.22.0 is a big release featuring the work of 153 contributors spread...

dependabot[bot]

Great project. Any plan for non-English languages?

1

Great project. Any plan for non-English languages?

jayjaywg

Error while running MakeFile

1

I'm running the makefile in my google collab notebook using !make -f Makefile and this error shows: > > FileNotFoundError: [Errno 2] No such file or directory: 'models/pretrained_models/RobertaModel_roberta-base_1e-05.pth' > Makefile:24:...

austinyoung1

Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.25.8 to 1.26.5. Release notes Sourced from urllib3's releases. 1.26.5 :warning: IMPORTANT: urllib3 v2.0 will drop support for Python 2: Read more in the v2.0 Roadmap Fixed...

dependabot[bot]

Hi. FYI, the [leaderboard](http://stereoset.mit.edu/) referenced in the README is currently down, with a "Connection refused" error from the browser.

chrish42