Regularization tools like Lasso have made a substantial progresses in regression modelling, particularly to high-dimensional data and multicollinear data. Whereas Ridge regression uses L2regularization to address the problem of multicollinearity, Lasso uses L1 regularization to conduct regression and feature selection together. The weaknesses of Lasso under correlated predictors have inspired the creation of a number of improved variants. The present paper will do a comparative analysis of simple Lasso, Ridge and Lasso extensions like Elastic Net, Adaptive Lasso, Group Lasso and Relaxed Lasso on real-world sports data, with special focus on a new implementation of the improved Relaxed Lasso that involves three optimization strategies: systematic grid search, extended lambda sequences, and nested cross-validation structures. The comparison has been done in terms of feature selection, resistance to outliers, and prediction accuracy on Ice Hockey, Cricket, and NBA data. Various measures of errors are used to analyze models: Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE) and Coefficient of Determination (R2). The results have shown that the Enhanced Relaxed Lasso performs best regarding improvements in performance especially in cricket data and still serves as a competitive data in different sporting scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Study on Robust Feature Selection Methods Using LASSO, LASSO Variants and Ridge Regression in Sports

  • B. Piravin,
  • S. Kalaivani,
  • Smrity Prasad

摘要

Regularization tools like Lasso have made a substantial progresses in regression modelling, particularly to high-dimensional data and multicollinear data. Whereas Ridge regression uses L2regularization to address the problem of multicollinearity, Lasso uses L1 regularization to conduct regression and feature selection together. The weaknesses of Lasso under correlated predictors have inspired the creation of a number of improved variants. The present paper will do a comparative analysis of simple Lasso, Ridge and Lasso extensions like Elastic Net, Adaptive Lasso, Group Lasso and Relaxed Lasso on real-world sports data, with special focus on a new implementation of the improved Relaxed Lasso that involves three optimization strategies: systematic grid search, extended lambda sequences, and nested cross-validation structures. The comparison has been done in terms of feature selection, resistance to outliers, and prediction accuracy on Ice Hockey, Cricket, and NBA data. Various measures of errors are used to analyze models: Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE) and Coefficient of Determination (R2). The results have shown that the Enhanced Relaxed Lasso performs best regarding improvements in performance especially in cricket data and still serves as a competitive data in different sporting scenarios.