Efficient cloud scheduling is critical for optimizing resource utilization and minimizing job latency, especially in workloads with inter-task dependencies. While existing federated scheduling frameworks like Megha improve scalability, they fall short in handling dependent tasks, leading to performance bottlenecks. In this paper, we propose Fedsort, a dependency-aware scheduling strategy integrated into the Megha architecture. Fedsort introduces task sorting, batching, and prioritized scheduling to efficiently manage inter-task dependencies. We enhance the MeghaSim simulator and evaluate our approach using real-world Alibaba traces and synthetic DAGs. Experimental results show that Fedsort reduces average job delay by up to 76.06.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Fedsort: An Optimized Federated Scheduling Strategy for Cloud Workloads with Inter-task Dependencies

  • Suhas Gowda Harish,
  • Shresht Veeraswamy Gunashekar,
  • Sparsh Balnad kattemane,
  • Meghana Thiyyakat,
  • Prafullata K. Auradkar

摘要

Efficient cloud scheduling is critical for optimizing resource utilization and minimizing job latency, especially in workloads with inter-task dependencies. While existing federated scheduling frameworks like Megha improve scalability, they fall short in handling dependent tasks, leading to performance bottlenecks. In this paper, we propose Fedsort, a dependency-aware scheduling strategy integrated into the Megha architecture. Fedsort introduces task sorting, batching, and prioritized scheduling to efficiently manage inter-task dependencies. We enhance the MeghaSim simulator and evaluate our approach using real-world Alibaba traces and synthetic DAGs. Experimental results show that Fedsort reduces average job delay by up to 76.06.