pytorch-cutpaste icon indicating copy to clipboard operation
pytorch-cutpaste copied to clipboard

I trained a model to eval another category ....

Open simo-an opened this issue 4 years ago • 1 comments

I train a model of wood using the command:

python run_training.py  --head_layer 2 --type wood

Then in the evaluate process, is use the model to evaluate the type of bottle , I got a surprisingly excellent result:

AUC: 0.9949454642192073

Is there any problem here?


I just used the following hard code to evaluate (in eval.py line 258):

roc_auc = eval_model(model_name, 'bottle', save_plots=args.save_plots, device=device, head_layer=args.head_layer, density=density())

Thanks!

simo-an avatar Dec 16 '21 08:12 simo-an

I just used the following hard code to evaluate (in eval.py line 258):

roc_auc = eval_model(model_name, 'bottle', save_plots=args.save_plots, device=device, head_layer=args.head_layer, density=density())

Thanks!

You hard coded bottle as the second argument. So I suspect you get the AUC of that class.

Instead of hardcoding you could also use the eval script:

python eval.py --head_layer 2 --type wood

Runinho avatar Dec 21 '21 19:12 Runinho