No Travel? No Problem.

Remote Participation
New Challenges of Benchmarking All-Flash Storage for HPC
Event Type
Data Analytics
Data Management
File Systems and I/O
Registration Categories
TimeMonday, 15 November 202110:30am - 10:55am CST
DescriptionThe proliferation of extreme-scale analytics and AI have motivated the creation of new parallel storage systems that either use all flash or combine nonvolatile memory (NVRAM) and flash to achieve the best attributes of both media. Clearly such storage systems have relevance in HPC, especially to meet the increasing needs of data analytics and AI in scientific computing, and evaluating such technologies for their applicability to HPC workloads is an important goal. In this paper we present a preliminary evaluation of the VAST storage system which incorporates NVRAM and QLC flash along with advanced technologies and algorithms to manage data between these two media. Our results show that traditional HPC performance measurement techniques struggle to properly characterize such architectures because they were designed to test much simpler storage systems. We discuss these shortcomings and propose alternative methods that better reflect the performance that real workflows can expect.
Back To Top Button