depthwise

icon indicating a website link https://www.linkedin.com/in/dmitrybelenko/

icon company Depthwise LLC icon location Seattle, WA icon location Depthwise LLC. Consulting folks on what to do and what not to do in AI (computer vision, edge, low level optimization, data, etc) and big data, since 2018.

Results 2 issues of depthwise

Sensitivity wrt LR restarts

12 comment

I'm observing sensitivity wrt LR restarts in a typical SGDR schedule with cosine annealing as in Loschilov & Hutter. RAdam still seems to be doing better than AdamW so far,...

question

Feature request: min/max values for logged metrics

32 comment

Thank you for developing such a useful service. As a practitioner I care disproportionately about the _peak_ metrics in any given run. I.e. max mAP50 for object detection (and min...

feature_request