<p>Both model averaging (MA) and variable screening have been subjects of extensive research. The literature has introduced various methods for variable screening, typically relying on a single approach, such as marginal correlation. However, the performances of such methods may be very poor outside of their specifically applicable scenarios, and it is often difficult to know which scenarios are proper in real data analysis. In this study, we propose a method called <i>Recommendation and Trimmed Mean Scoring</i> (RTMS) for variable screening, which enhances reliability and stability of variable screening by integrating rankings from multiple screening methods. We introduce a practical concept of <i>approximate consistency in ranking</i> of variables, establishing a theoretical property of the RTMS method in both hard sparse and gradually decaying coefficient scenarios. Simulation and empirical results demonstrate that the RTMS method outperforms individual ranking methods in terms of variable screening and predictive performance of MA as well.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Combining variable screening methods for model averaging in high-dimensional data analysis

  • Zhihao Zhao,
  • Yuhong Yang,
  • Li Wen

摘要

Both model averaging (MA) and variable screening have been subjects of extensive research. The literature has introduced various methods for variable screening, typically relying on a single approach, such as marginal correlation. However, the performances of such methods may be very poor outside of their specifically applicable scenarios, and it is often difficult to know which scenarios are proper in real data analysis. In this study, we propose a method called Recommendation and Trimmed Mean Scoring (RTMS) for variable screening, which enhances reliability and stability of variable screening by integrating rankings from multiple screening methods. We introduce a practical concept of approximate consistency in ranking of variables, establishing a theoretical property of the RTMS method in both hard sparse and gradually decaying coefficient scenarios. Simulation and empirical results demonstrate that the RTMS method outperforms individual ranking methods in terms of variable screening and predictive performance of MA as well.