MeanGSNR

class cockpit.quantities.MeanGSNR(track_schedule, verbose=False, epsilon=1e-05)

Quantitiy Class for the mean gradient signal-to-noise ratio (GSNR).

Note: Mean gradient signal-to-noise ratio as defined by

• Liu, J., et al. Understanding Why Neural Networks Generalize Well Through GSNR of Parameters (2020). https://arxiv.org/abs/2001.07384

Initialize.

Parameters

• track_schedule (callable) – Function that maps the global_step to a boolean, which determines if the quantity should be computed.

• verbose (bool, optional) – Turns on verbose mode. Defaults to False.

• epsilon (float) – Stabilization constant. Defaults to 1e-5.