max_ev_gauge

class cockpit.instruments.max_ev_gauge(self, fig, gridspec)[source]

Showing the largest eigenvalue of the Hessian versus iteration.

The largest eigenvalue of the Hessian indicates the loss surface’s sharpest valley. Together with the trace_gauge(), which provides a notion of “average curvature”, it can help understand the “average condition number” of the loss landscape at the current point. The instrument shows the largest eigenvalue of the Hessian versus iteration, overlayed with an exponentially weighted average.

Preview

Preview HessMaxEV Gauge

Requires

The trace instrument requires data from the HessMaxEv quantity class.

Parameters