This survey paper explores the key challenges involved in optimizing MPI collective communication operations, particularly MPI_Alltoall and MPI_Alltoallv, which are essential for achieving efficient parallelism in high-performance computing (HPC) environments. These challenges include scalability limitations, heterogeneous computing systems, and the difficulty of balancing communication overhead with computational demands. As data volumes grow and HPC systems become increasingly complex, these collective operations often emerge as critical bottlenecks, significantly affecting performance. To address these challenges, the paper investigates the following research questions: What are the primary limitations of current MPI_Alltoall and MPI_Alltoallv algorithms in terms of scalability, heterogeneity, and communication-computation balance? What optimization strategies, including algorithmic innovations, system-level enhancements, and application-specific techniques, have been proposed, and how effective are they in addressing these limitations? What trends and research gaps exist in the optimization of collective communication operations, and what future directions should researchers explore to overcome these challenges?

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Survey of Optimization Approaches for MPI_Alltoall and MPI_Alltoallv Collective Communication Operations

  • Evelyn Namugwanya,
  • Grace Nansamba,
  • Amr Akmal Abouelmagd,
  • Anthony Skjellum

摘要

This survey paper explores the key challenges involved in optimizing MPI collective communication operations, particularly MPI_Alltoall and MPI_Alltoallv, which are essential for achieving efficient parallelism in high-performance computing (HPC) environments. These challenges include scalability limitations, heterogeneous computing systems, and the difficulty of balancing communication overhead with computational demands. As data volumes grow and HPC systems become increasingly complex, these collective operations often emerge as critical bottlenecks, significantly affecting performance. To address these challenges, the paper investigates the following research questions: What are the primary limitations of current MPI_Alltoall and MPI_Alltoallv algorithms in terms of scalability, heterogeneity, and communication-computation balance? What optimization strategies, including algorithmic innovations, system-level enhancements, and application-specific techniques, have been proposed, and how effective are they in addressing these limitations? What trends and research gaps exist in the optimization of collective communication operations, and what future directions should researchers explore to overcome these challenges?