In recent years, the rapid rise of Artificial Intelligence Generated Content (AIGC) has been accompanied by a surge in demand for generative AI application services. This trend has not only driven the diversified deployment of large-scale models but also posed more significant challenges to the efficient inference of these models. Current computing solutions have struggled to solely keep pace with growing user demands, which results in insufferable latency and inefficient performance. Integrating cloud computing and edge computing for the inference process of large models is deemed a promising solution, while related resource scheduling issues are still pending. To address this challenge, we focus our research on diffusion models, a representative model in the field of generative artificial intelligence, and propose a cloud-edge collaborative framework to accelerate the inference pipeline of text-to-image diffusion models. Our optimization goal is to minimize the average completion time of inference tasks while maintaining image quality. Considering that the inference for each image is an iterative process, we propose a step clipping strategy to save and reuse intermediate results to reduce iterations, compressing the calculation amount of inference tasks. Above this, we design a task scheduling strategy using proximal policy optimization, which can make efficient resource decisions. Experiments demonstrate the superiority of our strategy over local execution, greedy task scheduling strategy, and learning-based task scheduling strategies. Compared with the three baselines, the average task completion time under different system configurations is reduced by 1.093 s, 1.024 s, and 0.481 s, respectively.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

SC-TSDRL: A Cloud-Edge Collaboration Framework for Diffusion Model Inference Acceleration

  • Huiyu Wang,
  • Zhicheng Liu,
  • Xiaofei Wang,
  • Chao Qiu,
  • Cheng Zhang,
  • Wenyu Wang,
  • Qianwen Ye

摘要

In recent years, the rapid rise of Artificial Intelligence Generated Content (AIGC) has been accompanied by a surge in demand for generative AI application services. This trend has not only driven the diversified deployment of large-scale models but also posed more significant challenges to the efficient inference of these models. Current computing solutions have struggled to solely keep pace with growing user demands, which results in insufferable latency and inefficient performance. Integrating cloud computing and edge computing for the inference process of large models is deemed a promising solution, while related resource scheduling issues are still pending. To address this challenge, we focus our research on diffusion models, a representative model in the field of generative artificial intelligence, and propose a cloud-edge collaborative framework to accelerate the inference pipeline of text-to-image diffusion models. Our optimization goal is to minimize the average completion time of inference tasks while maintaining image quality. Considering that the inference for each image is an iterative process, we propose a step clipping strategy to save and reuse intermediate results to reduce iterations, compressing the calculation amount of inference tasks. Above this, we design a task scheduling strategy using proximal policy optimization, which can make efficient resource decisions. Experiments demonstrate the superiority of our strategy over local execution, greedy task scheduling strategy, and learning-based task scheduling strategies. Compared with the three baselines, the average task completion time under different system configurations is reduced by 1.093 s, 1.024 s, and 0.481 s, respectively.