The MPI BUGS INITIATIVE: a Framework for MPI Verification Tools Evaluation
Event Type
Workshop
Online Only
Correctness
Parallel Programming Languages and Models
Reliability and Resiliency
Software Engineering
W
TimeFriday, 19 November 20219:20am - 9:40am CST
LocationOnline
DescriptionEnsuring the correctness of MPI programs becomes as challenging and important as achieving the best performance. Many tools have been proposed in the literature to detect incorrect usages of MPI in a given program. However, the limited set of code samples each tool provides and the lack of metadata stating the intent of each test make it difficult to assess the strengths and limitations of these tools. In this paper, we present the MPI BUGS INITIATIVE, a complete collection of MPI codes to assess the status of MPI verification tools. We introduce a classification of MPI errors and provide correct and incorrect codes covering many MPI features and our categorization of errors. The resulting suite comprises 1,668 codes, each coming with a well-formatted header that clarifies the intent of each code and specifies how to execute and evaluate it. We evaluated the completeness of the MPI BUGS INITIATIVE against eight state-of-the-art MPI verification tools.
