GradNorm

class cockpit.quantities.GradNorm(track_schedule, verbose=False)[source]

Quantitiy Class for tracking the norm of the mean gradient.

Initialization sets the tracking schedule & creates the output dict.

Parameters

  • track_schedule (callable) – Function that maps the global_step to a boolean, which determines if the quantity should be computed.

  • verbose (bool, optional) – Turns on verbose mode. Defaults to False.