May 13, 2025
Conference Paper

AutoCheck: Automatically Identifying Variables for Checkpointing by Data Dependency Analysis

Abstract

Checkpoint/Restart (C/R) has been widely deployed in numerous HPC systems, Clouds, and industrial data centers, which are typically operated by system engineers. Nevertheless, there is no existing approach that helps system engineers without domain expertise and domain scientists without system fault tolerance knowledge identify those critical variables accounted for correct application execution restoration in a failure for C/R. To address this problem, we propose an analytical model and a tool (AutoCheck) that can automatically identify critical variables to checkpoint for C/R. AutoCheck relies on first, analytically tracking and optimizing data dependency between variables and other application execution state, and second, a set of heuristics that identify critical variables for checkpointing from the refined data dependency graph (DDG). AutoCheck allows programmers to pinpoint critical variables to checkpoint quickly within a few minutes. We evaluate AutoCheck on 13 representative HPC benchmarks, demonstrating that AutoCheck can efficiently identify correct critical variables to checkpoint.

Published: May 13, 2025

Citation

Fu X., W. Zhang, S. Meng, X. Huang, W. Xu, L. Guo, and K. Sato. 2024. AutoCheck: Automatically Identifying Variables for Checkpointing by Data Dependency Analysis. In International Conference for High Performance Computing, Networking, Storage and Analysis (SC 24), November 17-22, 2024, Atlanta, GA, 1-16. Piscataway, New Jersey:IEEE. PNNL-SA-204756. doi:10.1109/SC41406.2024.00105

Research topics