Workflow scheduling in heterogeneous environments presents significant challenges due to complex task dependencies, particularly for data-intensive workflows where data transmission time substantially affects scheduling performance and consumes considerable bandwidth. This paper introduces a Communication-aware Duplication-based Workflow Scheduling algorithm (CDWS) that enhances scheduling efficiency through strategically duplicating critical predecessors of tasks and co-locating them on the same computational resources, followed by an elimination phase to remove redundant resource occupancy. The key idea is to reduce costly data transfers thereby improving overall makespan. Extensive simulation using synthetic data from four real-world scientific workflows shows that CDWS outperforms other approaches across key metrics such as normalized schedule length, data transmission volume and resource utilization, while maintaining low computational complexity.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Duplication-Based Workflow Scheduling with Communication Awareness for Heterogeneous Cloud Computing Environments

  • Yani Ping,
  • Rizos Sakellariou

摘要

Workflow scheduling in heterogeneous environments presents significant challenges due to complex task dependencies, particularly for data-intensive workflows where data transmission time substantially affects scheduling performance and consumes considerable bandwidth. This paper introduces a Communication-aware Duplication-based Workflow Scheduling algorithm (CDWS) that enhances scheduling efficiency through strategically duplicating critical predecessors of tasks and co-locating them on the same computational resources, followed by an elimination phase to remove redundant resource occupancy. The key idea is to reduce costly data transfers thereby improving overall makespan. Extensive simulation using synthetic data from four real-world scientific workflows shows that CDWS outperforms other approaches across key metrics such as normalized schedule length, data transmission volume and resource utilization, while maintaining low computational complexity.