Common use of Notations Clause in Contracts

Notations. Here we define some notations, which will be used in the following sections. • At (f (θ)): Training f (θ) with loss L for t steps, where t can be omitted for simplicity. • Pp L(f (θ)) : Pruning f (θ) using pruning method p and training loss L. • M(f (mθ)): Extracting the pruning mask of f (mθ), i.e., M(f (mθ)) = m. • std, ▇▇▇, reweight, confreg and p imp, imp-rw, mask , where “imp” and “imp- rw”denote the standard IMP and IMP with weight rewinding, as described in Section 3.2.1. “mask” stands for mask training. • Ed(f (θ)): Evaluating f (θ) on the test data with distribution d ∈ {ID, OOD}.