Regularization Techniques for Sparsity
摘要
Inducing sparsity is an important way to improve the efficiency of deep neural networks. This chapter will discuss why sparsity is desired in a neural network model, and introduce regularization-based methods to induce such sparsity. We will start our discussion with the simple LASSO regularization, then move on to discuss the use of its variants and other regularization techniques beyond LASSO.