BluePyOpt icon indicating copy to clipboard operation
BluePyOpt copied to clipboard

Add a way to record features extracted during optimisations

Open wvangeit opened this issue 8 years ago • 6 comments

At the moment the scores of the parameters are returned to the master process. We should also have a way to e.g. get the raw efeature values out. This would be useful for sensitivity analysis e.g.

wvangeit avatar Jun 23 '17 14:06 wvangeit

It would be very nice to have this enhancement. For example to analyse how features extracted from good models compare to the experimental ones.

elisabettai avatar Sep 08 '17 09:09 elisabettai

I will see when I have time to implement this. It won't be trivial, because it involves some changes to the current user-facing API. I'll try to implement in a way so that it doesn't affect existing scripts.

wvangeit avatar Sep 11 '17 07:09 wvangeit

Ok, I see. Another solution would be to re-run models (>10, potentially hundreds parameter combinations). Maybe this can be efficiently done in parallel (using multiprocessing or ipyparallel), by re-using existing code.

elisabettai avatar Sep 11 '17 07:09 elisabettai

Yes, for now that might be the best solution. You could use the ipyparallel map function for that. You would only have to pass a function that returns the feature values instead of the scores. Another option is to subclass response or score calculator classes and let them write out the feature values they see to files.

wvangeit avatar Sep 11 '17 10:09 wvangeit

@DrTaDa, could you have a look at this. It's an often requested feature. Not urgent though.

wvangeit avatar Aug 14 '20 12:08 wvangeit

Does #350 answer entirely to what was requested here ?

DrTaDa avatar Feb 24 '21 09:02 DrTaDa