Overlapping Communication and Computation with ExaMPI's Strong Progress and Modern C++ Design
Event Type
Workshop
Online Only
Extreme Scale Comptuing
Parallel Programming Languages and Models
Performance
W
TimeSunday, 14 November 202111:30am - 12pm CST
LocationOnline
DescriptionExaMPI is a modern, C++17+ MPI implementation designed for modularity, extensibility, and understandability. In this work, we overview functionality new to ExaMPI since its initial release, including Libfabric-based network transport support. We also explain our rationale for why and how we choose to add new MPI features (and defer others). We also measured the latency of the aforementioned transports in ExaMPI and found that ExaMPI, while having slightly higher latency than other production MPIs, is competitive. Lastly, we tested the ability for ExaMPI's strong progress engine to enable overlap communication and computation, finding that considerable overlap is achieved without needing additional MPI helper calls such as MPI_Test.
