PheScale: Leveraging Transformer Models for Proactive VM Auto-scaling
摘要
Auto-scaling is essential for real-time resource adjustment in cloud services. Traditional reactive methods often delay in reacting to sudden workload spikes, causing performance degradation. Recent proactive methods alleviate this but still face several obstacles: cold-start issues, improper resource utilization, and lacking a cloud-native AI ecosystem. We propose PheScale, a Transformer-based auto-scaling framework for workload prediction and scaling decision. It employs an Adaptive Sequence Transformation for cold-start, a time-sensitive Gaussian filtering scaler for efficient decisions, and a Libtorch wrapper by Golang to assist invocation of Torch models. Experiments on real-world data demonstrate the effectiveness of PheScale.