The International Conference for High Performance Computing, Networking, Storage, and Analysis
The International Conference for High Performance Computing, Networking, Storage, and Analysis
Workshop:PDSW: Sixth International Parallel Data Systems Workshop
Authors: Houjun Tang (Lawrence Berkeley National Laboratory (LBNL)), Bing Xie (Oak Ridge National Laboratory (ORNL)), Suren Byna (Lawrence Berkeley National Laboratory (LBNL)), Philip Carns (Argonne National Laboratory (ANL)), Quincey Koziol (Lawrence Berkeley National Laboratory (LBNL)), Sudarsun Kannan (Rutgers University), Jay Lofstead (Sandia National Laboratories), and Sarp Oral (Oak Ridge National Laboratory (ORNL))
Abstract: This work proposes SCTuner, an auto-tuner integrated within I/O library itself to dynamically tune both the I/O library and the underlying I/O stack at application runtime. To this end, we introduce a statistical benchmarking method to profile the behaviors of individual supercomputer I/O sub-systems with varied configurations across I/O layers. We use the benchmarking results as the built-in knowledge in SCTuner, implement an I/O pattern extractor and plan to implement an online performance tuner as the SCTuner runtime. We conducted a benchmarking analysis on the Summit supercomputer and its GPFS file system Alpine. The preliminary results show that our method can effectively extract the consistent I/O behaviors of the target system under production load, building the base for I/O auto-tuning at application runtime.
Back to PDSW: Sixth International Parallel Data Systems Workshop Archive Listing