trace_gauge

class cockpit.instruments.trace_gauge(self, fig, gridspec)[source]

Trace gauge, showing the trace of the Hessian versus iteration.

The trace of the hessian is the sum of its eigenvalues and thus can indicate the overall or average curvature of the loss landscape at the current point. Increasing values for the trace indicate a steeper curvature, for example, a narrower valley. This instrument shows the trace versus iteration, overlayed with an exponentially weighted average.

Preview

Preview HessTrace Gauge

Requires

The trace instrument requires data from the HessTrace quantity class.

Parameters