No Travel? No Problem.

Remote Participation
Exploiting User Activeness for Data Retention in HPC Systems
Event Type
Paper
Tags
Applications
Big Data
Datacenter
File Systems and I/O
Machine Learning and Artificial Intelligence
State of the Practice
Storage
Reproducibility Badges
Registration Categories
TP
TimeThursday, 18 November 20213:30pm - 4pm CST
Location240-241-242
DescriptionHPC systems typically rely on the fixed-lifetime (FLT) data retention strategy, which only considers temporal locality of data accesses to parallel file systems. Our extensive analysis based on the leadership-class HPC system traces, however, suggests that the FLT approach often fails to capture the dynamics in users' behavior and leads to undesired data purge. In this study, we propose an activeness-based data retention (ActiveDR) solution, which advocates considering the data retention approach from a holistic activeness-based perspective. By evaluating the frequency and impact of users' activities, ActiveDR prioritizes the file purge process for inactive users and rewards active users with extended file lifetime on parallel storage. Our extensive evaluations based on the traces of the prior Titan supercomputer show that, when reaching the same purge target, ActiveDR achieves up to 37% file miss reduction as compared to the current FLT retention methodology.
Back To Top Button