gradient_tests_gauge

class cockpit.instruments.gradient_tests_gauge(self, fig, gridspec)[source]

Gauge, showing the the status of several gradient tests.

All three gradient tests (the norm test, the inner product test, and the orthogonality test) indicate how strongly individual gradients in a mini-batch scatter around the mean gradient. This information can be used to adapt the batch size whenever the information becomes to noisy, as indicated by large values.

The central plot visualizes all three tests in different colors. Each area shows how far the individual gradients scatter. The smaller plots show their evolution over time.

Preview

Requires

The gradient test instrument requires data from all three gradient test quantities, namely the InnerTest, NormTest, and OrthoTest quantity classes.

Parameters

self (CockpitPlotter) – The cockpit plotter requesting this instrument.
fig (matplotlib.figure.Figure) – Figure of the Cockpit.
gridspec (matplotlib.gridspec.GridSpec) – GridSpec where the instrument should be placed