PyExplainer icon indicating copy to clipboard operation
PyExplainer copied to clipboard

Not getting an expected output

Open ShraddhaDevaiya opened this issue 3 years ago • 9 comments

Hello, I am using the pyexplainer to explain the data regarding the bug report. following is my input data :

image

and the feature data is like this:

image

and for this pyexplainer is giving output like this:

image

which doesn't seem like an explanation. can you please suggest, am I missing anything?

ShraddhaDevaiya avatar Aug 19 '22 16:08 ShraddhaDevaiya

Hi @ShraddhaDevaiya, I just tested the current version of the package and found no issues with the front-end components. There could be a case where the "RuleFit" local model (it is used to generate rules which will be presented in the UI as explanations) used by pyexplainer could not generate rules for your input. May I ask a few questions (1) what kind of model did you try to explain? (2) did you use default parameters when calling the "explain" function?

MichaelFu1998-create avatar Aug 20 '22 00:08 MichaelFu1998-create

Hello,

the random forest model you are asking, that only I tried to explain, and the explain function I am using like this :

rules = py_explainer.explain(X_explain=X_explain, y_explain=y_explain, search_function='crossoverinterpolation')

Did you ask this?

ShraddhaDevaiya avatar Aug 20 '22 00:08 ShraddhaDevaiya

Hi @ShraddhaDevaiya, It looks alright to me.

Did you train your own RF model? What is the approximate size of your training data?

MichaelFu1998-create avatar Aug 20 '22 00:08 MichaelFu1998-create

yes, I trained the RF model. and the training data size is only 10 items. so that could be the issue, means very less data to train the model?

ShraddhaDevaiya avatar Aug 20 '22 00:08 ShraddhaDevaiya

Hi @ShraddhaDevaiya , Yes, I think that could be the case. We trained the RF model using around 9k data points in our original experiments. However, I'm not sure how much data should be to train the model. You may grab more data and try if it works.

Also, I find that the current version of pyexplainer can be improved, the UI should tell the user in the case that the rules can't be generated, otherwise, it would be confusing like what you've just encountered. Thanks for opening this issue, I'll improve the UI accordingly.

MichaelFu1998-create avatar Aug 20 '22 01:08 MichaelFu1998-create

Thanks for helping. Let me check with the more number of training data.

ShraddhaDevaiya avatar Aug 20 '22 01:08 ShraddhaDevaiya

Okay, I'll leave this open for a while then If you still have any concerns, feel free to comment here.

MichaelFu1998-create avatar Aug 20 '22 01:08 MichaelFu1998-create

sure, thanks !

ShraddhaDevaiya avatar Aug 20 '22 01:08 ShraddhaDevaiya

Hello @MichaelFu1998-create , I have tried with 2k data inputs for training, but still it is giving the same kind of output. It is not showing any explanation.

ShraddhaDevaiya avatar Aug 23 '22 18:08 ShraddhaDevaiya