and bias . Let denote the output of the -th layer. If we assume no activations are applied for simplicity, then we can compute the output of the -th layer as follows: With in the base case. If we have

using the magnitude of the weights, which has become a popular pruning technique because of its simplicity and effectiveness. Later on in this chapter, we have a project that relies on it for sparsifying