DARVFL-LSTM: a time series prediction model integrating dynamic regularization and attention mechanism
摘要
Time series forecasting is a critical task in various domains, such as finance, energy, transportation, and meteorology, which involves predicting future trends based on historical data. However, existing time series forecasting models often struggle to simultaneously capture short-term volatility and long-term dependencies in complex, nonlinear data. These limitations are directly addressed in this paper through the integration of dynamic regularization and attention mechanisms. We propose a novel hybrid model that integrates dynamic regularization (DR) and attention mechanisms into the random vector functional link long short-term memory (RVFL-LSTM) framework, named dynamic attention-enhanced RVFL-LSTM (DARVFL-LSTM), to effectively handle nonlinear and non-stationary time series data. DR dynamically adjusts the regularization strength based on the data’s volatility, effectively balancing the learning of short-term and long-term patterns. The attention mechanism assigns dynamic weights to sliding window observations, emphasizing key data points to enhance short-term feature extraction. Comprehensive experiments on eight public time series datasets demonstrate that DARVFL-LSTM significantly outperforms baseline models, including RVFL-LSTM, long short-term memory (LSTM), and online sequential extreme learning machine (OS-ELM), in terms of accuracy and adaptability. Moreover, ablation and efficiency analyses confirm the complementary roles of DR and attention mechanisms. The results establish DARVFL-LSTM as an efficient and precise solution for complex time series forecasting tasks, particularly in application domains such as energy load prediction, traffic forecasting, weather analysis, and financial trend modeling.