January 1, 2010
Journal Article

Implementation and Evaluation of Active Storage in Modern Parallel File Systems

Abstract

Active Storage is a technology aimed at reducing the bandwidth requirements of current supercomputing systems, and leveraging the processing power of the storage nodes used by some modern file systems. Active Storage achieves both objectives by moving certain processing tasks to the storage nodes, near the data they manage. Our proposal for Active Storage has several key features: user-space implementation which facilitates the port to different file systems, analytical model to anticipate the performance of Active Storage with respect to a traditional system, support for striped files and complex format files such as netCDF, scientific-friendly programming and runtime environment, etc.

Revised: April 26, 2010 | Published: January 1, 2010

Citation

Piernas Canovas J., and J. Nieplocha. 2010. Implementation and Evaluation of Active Storage in Modern Parallel File Systems. Parallel Computing 36, no. 1:26-47. PNNL-SA-63800.