WA-Testing-Tool
WA-Testing-Tool copied to clipboard
cognitive-catalyst
Scripts that run against Watson Assistant for K fold validation on training set, testing on blind test, and draw precision curves for comparison.
Update to more reasonable & modern default ``` config.ini.sample ;API version, default is 2019-02-28, specify the version matching your Watson Assistant ;version= ``` ``` notebook_ws/WA-Testing-Tool-WS-Python-Notebook.ipynb: " 'version' : '2019-02-28', #;...
At minimum link to this 3-part blog (w/ embedded video) series: Type | Title | Link -- | -- | -- Blog | Testing a Chatbot with k-folds Cross Validation...
``` $ python3 run.py -c config.ini Traceback (most recent call last): File "run.py", line 27, in from ibm_watson import NaturalLanguageClassifierV1 ImportError: cannot import name 'NaturalLanguageClassifierV1' from 'ibm_watson' (/Users/Default/Library/Python/3.8/lib/python/site-packages/ibm_watson/__init__.py) ``` https://cloud.ibm.com/docs/natural-language-classifier?topic=natural-language-classifier-about...
Need to update tool or confirm it works well for Action-based assistants, not just Dialog-based.
See https://github.com/cognitive-catalyst/WA-Testing-Tool/issues/212 Undo or revise NLC flow added here: https://github.com/cognitive-catalyst/WA-Testing-Tool/pull/114 If this functionality is still available in another service, add the necessary modifications. Otherwise, remove NLC code and restore original...
Is there an easy way to connect to Watson URL using proxy. The customer organisation can connect to URL using proxy, hence looking for a way to use proxy in...
Section 3 in the Notebook does not check for the 'mode' parameter set in section 2.1. Exceptions are thrown on first run of the Testing Tool. If a first run...
A number of cells (11) in Section 3 of the Python notebook are calling the 'copy_python_env_file_to_project_asset' function. Although it is commented, when attempting to utilize, it will error because the...
The Watson API endpoint URLs on 'watsonplatform.net' will be retired and cease to function on May 26, 2021. There is an open call to update any references to the newer...
See #113 and #176 >Upon further testing, the additional parts of the json we may want to capture for future enhancements are related to the "webhooks" section. Probably not urgent,...
Metadata
Owner
Metadata
Scripts that run against Watson Assistant for K fold validation on training set, testing on blind test, and draw precision curves for comparison.