adatest
adatest copied to clipboard
microsoft
Find and fix bugs in natural language machine learning models using adaptive testing.
Running the sample notebook "Testing Models -- Sentence Pair Classification". Following code: ``` # Launch AdaTest! tests.adapt( model, generator=gen_model, auto_save=True, # Set to "True" to automatically save tests as they...
The constructor for `CVModel` in `TopicMembershipModel` is incorrect and is causing adatest to throw errors when generating topics: ``` TypeError: CVModel.__init__() missing 2 required positional arguments: 'embeddings' and 'labels' ```...
got the following error with "import adatest" partially initialized module 'adatest' has no attribute 'generators' (most likely due to a circular import)
Bumps [minimatch](https://github.com/isaacs/minimatch) from 3.0.4 to 3.1.2. Commits 699c459 3.1.2 2f2b5ff fix: trim pattern 25d7c0d 3.1.1 55dda29 fix: treat nocase:true as always having magic 5e1fb8d 3.1.0 f8145c5 Add 'allowWindowsEscape' option 570e8b1...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [webpack](https://github.com/webpack/webpack) from 5.73.0 to 5.76.0. Release notes Sourced from webpack's releases. v5.76.0 Bugfixes Avoid cross-realm object access by @Jack-Works in webpack/webpack#16500 Improve hash performance via conditional initialization by @lvivski...
Bumps [json5](https://github.com/json5/json5) from 2.2.0 to 2.2.2. Release notes Sourced from json5's releases. v2.2.2 Fix: Properties with the name __proto__ are added to objects and arrays. (#199) This also fixes a...
Reworks the way that Adatest's front end handles data caching and refreshes stale data. ## Description of work - Data fetched from backend is now stored in a Redux store,...
Bumps [loader-utils](https://github.com/webpack/loader-utils) from 1.4.0 to 1.4.2. Release notes Sourced from loader-utils's releases. v1.4.2 1.4.2 (2022-11-11) Bug Fixes ReDoS problem (#226) (17cbf8f) v1.4.1 1.4.1 (2022-11-07) Bug Fixes security problem (#220) (4504e34)...
When there are enough samples to fit a model `TopicMembershipModel` calls empty `CVModel()` [Line 160](https://github.com/microsoft/adatest/blob/main/adatest/_topic_model.py#L160)
A very simple smoke test of the `PromptBuilder` class, which checks that all of the returned values are rows within the supplied test tree.
