<p>Effective capacity planning in cloud computing must balance profit maximization against the dual uncertainties of internal server faults and external traffic bursts. According to the supply-demand relationship between cloud service providers (CSPs) and customers, satisfying the interests of both is crucial for the sustained operation of the cloud computing system. Generally, due to the dynamic uncertainty of the cloud environment, server failures sometimes occur, resulting in the deterioration of system performance. Unfortunately, such a situation is currently not fully considered in cloud resource configuration. In this paper, our objective is to achieve the optimal configuration of resources in the cloud computing system in the presence of server transient faults, with the aim of maximizing profit and the service completion rate. By introducing queuing theory, we establish a multi-server queuing model to depict the service process of customer requests. Then, by considering the interactions among several server states and following the same methodology, the handling process of transient faults can also be defined as a specific queuing model. Combined with the analysis of the two models, the probability density function (pdf) of the generalized waiting time of customers is initially designed to investigate the quality of service. On this basis, the models of profit and service completion rate are constructed. Taking into account the potential for problem dimensionality scaling, two heuristic algorithms are employed to obtain the optimal solutions for such models, thereby simultaneously satisfying the requirements of both cloud service providers (CSPs) and customers. Furthermore, sensitivity analysis reveals that for both typical and high-failure cloud environments, the system favors a light-asset, elastic recovery strategy (characterized by minimal static redundancy) over heavy static buffering. Finally, trace-driven simulations using Google Cluster Data quantify the economic limits of static provisioning, demonstrating that handling extreme traffic bursts (<InlineEquation ID="IEq1"><EquationSource Format="TEX">\(CV \gg 1\)</EquationSource></InlineEquation>) purely via static capacity incurs a 60% resource wastage. These results position our model as a foundational tool for Base Capacity Planning, identifying the precise economic boundaries where dynamic scaling mechanisms must intervene for both fault tolerance and traffic bursts.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Transient-fault-aware optimal configuration for cloud service providers: a composite queuing modeling approach

  • Siyi Chen,
  • Wenhao Xu,
  • Junyan Li,
  • Haiyang Kuang,
  • Huixian Huang

摘要

Effective capacity planning in cloud computing must balance profit maximization against the dual uncertainties of internal server faults and external traffic bursts. According to the supply-demand relationship between cloud service providers (CSPs) and customers, satisfying the interests of both is crucial for the sustained operation of the cloud computing system. Generally, due to the dynamic uncertainty of the cloud environment, server failures sometimes occur, resulting in the deterioration of system performance. Unfortunately, such a situation is currently not fully considered in cloud resource configuration. In this paper, our objective is to achieve the optimal configuration of resources in the cloud computing system in the presence of server transient faults, with the aim of maximizing profit and the service completion rate. By introducing queuing theory, we establish a multi-server queuing model to depict the service process of customer requests. Then, by considering the interactions among several server states and following the same methodology, the handling process of transient faults can also be defined as a specific queuing model. Combined with the analysis of the two models, the probability density function (pdf) of the generalized waiting time of customers is initially designed to investigate the quality of service. On this basis, the models of profit and service completion rate are constructed. Taking into account the potential for problem dimensionality scaling, two heuristic algorithms are employed to obtain the optimal solutions for such models, thereby simultaneously satisfying the requirements of both cloud service providers (CSPs) and customers. Furthermore, sensitivity analysis reveals that for both typical and high-failure cloud environments, the system favors a light-asset, elastic recovery strategy (characterized by minimal static redundancy) over heavy static buffering. Finally, trace-driven simulations using Google Cluster Data quantify the economic limits of static provisioning, demonstrating that handling extreme traffic bursts (\(CV \gg 1\)) purely via static capacity incurs a 60% resource wastage. These results position our model as a foundational tool for Base Capacity Planning, identifying the precise economic boundaries where dynamic scaling mechanisms must intervene for both fault tolerance and traffic bursts.