Add histogram summaries to `GnnModelBase`.

Open virajbshah opened this issue 10 months ago • 2 comments

Adds a call to a new no-op method to set up histogram summaries to the model initialization pipeline.
Overrides this in GnnModelBase to log histogram summaries for all of its trainable variables, i.e. those in the graph network layers.

Apr 14 '25 08:04 virajbshah

It's supposed to be an extra diagnostic to catch things like some weights exploding or gradients vanishing. I added it to compare embedding distributions between regular and context nodes.

Jul 04 '25 08:07 virajbshah

It's supposed to be an extra diagnostic to catch things like some weights exploding or gradients vanishing. I added it to compare embedding distributions between regular and context nodes.

Ah, okay. Definitely makes sense as a diagnostic tool for that. And I guess the size increase isn't large because it's just a histogram over each layer.

Jul 04 '25 14:07 boomanaiden154