deepmind-research icon indicating copy to clipboard operation
deepmind-research copied to clipboard

Optimize fitness value

Open germanjke opened this issue 5 years ago • 0 comments

In original BKRGA paper, and in your REGAL paper we have some fitness value function which one we want to minimize.

In original device placement task we want to minimize runtime of inference/training of deep neural network. But this value is linear and we can't apply gradient descent to this problem.

How do you think, can we apply some loss function to update our fitness value function, e.g. square some things, maybe add some bias value?

For example, fitness_value = runtime**2 + some_feature

I have a question, REGAL have no conflicts with modify fitness value functions?

germanjke avatar Mar 24 '21 14:03 germanjke