Overlapping Communication and Computation with ExaMPI's Strong Progress and Modern C++ Design

Workshop:ExaMPI: Workshop on Exascale MPI

Authors: Derek Schafer, Thomas Hines, and Evan Suggs (University of Tennessee, Chattanooga); Martin Rüfenacht (Leibniz Supercomputing Centre); and Anthony Skjellum (University of Tennessee, Chattanooga)

Abstract: ExaMPI is a modern, C++17+ MPI implementation designed for modularity, extensibility, and understandability. In this work, we overview functionality new to ExaMPI since its initial release, including Libfabric-based network transport support. We also explain our rationale for why and how we choose to add new MPI features (and defer others). We also measured the latency of the aforementioned transports in ExaMPI and found that ExaMPI, while having slightly higher latency than other production MPIs, is competitive. Lastly, we tested the ability for ExaMPI's strong progress engine to enable overlap communication and computation, finding that considerable overlap is achieved without needing additional MPI helper calls such as MPI_Test.

Back to ExaMPI: Workshop on Exascale MPI Archive Listing

Back to Full Workshop Archive Listing