checklist
checklist copied to clipboard
Beyond Accuracy: Behavioral Testing of NLP models with CheckList
great material as usual do you have some progress in this directions since 2 years ago
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.13.0 to 1.15.4. Commits 6585820 Release version 1.15.4 of the npm package. 7a6567e Disallow bracketed hostnames. 05629af Prefer native URL instead of deprecated url.parse. 1cba8e8 Prefer native...
Getting the following error in setup.py when installing from pip ``` AttributeError: module 'notebook' has no attribute 'nbextensions' ``` Noted that it is installing the latest version of notebook rather...
Because template values are in part based on the order of the `keys` (e.g. `{city1}, {city2}` vs `{city2}, {city1}` will output two different texts even given the same sets of...
Bumps [browserify-sign](https://github.com/crypto-browserify/browserify-sign) from 4.0.4 to 4.2.2. Changelog Sourced from browserify-sign's changelog. v4.2.2 - 2023-10-25 Fixed [Tests] log when openssl doesn't support cipher [#37](https://github.com/crypto-browserify/browserify-sign/issues/37) Commits Only apps should have lockfiles 09a8995...
my read program ```python import checklist from checklist.test_suite import TestSuite suite_path = 'release_data/qqp/qqp_suite.pkl' suite = TestSuite.from_file(suite_path) ``` Error reported after running the program ``` Traceback (most recent call last): File...
Bumps [tar](https://github.com/isaacs/node-tar) to 6.2.0 and updates ancestor dependency [node-sass](https://github.com/sass/node-sass). These dependencies need to be updated together. Updates `tar` from 4.4.13 to 6.2.0 Release notes Sourced from tar's releases. v6.1.13 6.1.13...
Hi, I am trying to use checklist tool for testing zero-shot classification ML project. However, when I run suite.visual_summary_table() in Jupiternotebook i get below error. Please wait as we prepare...
Change the names with names from a special gender and country. Useful to test the biases of a model toward gender or ethnicity
This line `f = open(path, 'w'')` needs to have `encoding='utf-8'` to work properly in Windows and avoid the following error when characters are not `UnicodeEncodeError: 'charmap' codec can't encode character...