In this chapter, we expand the supervised learning context into regression, another major type of machine learning tasks. A revisit to the learning framework is first paid, which gives the setting for the rest of the chapter as well as later topics such as model selection. Coverage on regression algorithms follows, with the linear regression model as the foundations for other advanced algorithms with customized regularization mechanisms employed.