April 18, 2008
Conference Paper

Early Experience with Out-of-Core Applications on the Cray XMT

Abstract

This paper describes early experience with a preproduction Cray XMT system that implements a scalable shared memory architecture with hardware support for multithreading. Unlike its predecessor, the Cray MTA-2 that had very limited I/O capability, the Cray XMT offers Lustre, a scalable high-performance parallel filesystem. Therefore it enables development of out-of-core applications that can deal with very large data sets that otherwise would not fit the system main memory. Our application performs statistically-based anomaly detection for categorical data that can be used for Internet traffic analysis. Our results indicate that the preproduction version of the machine is able to achieve good performance and scalability for the in-and out-of-core versions of the example application.

Revised: March 9, 2009 | Published: April 18, 2008

Citation

Chavarría-Miranda D., A. Marquez, J. Nieplocha, K.J. Maschhoff, and C. Scherrer. 2008. Early Experience with Out-of-Core Applications on the Cray XMT. In IEEE International Symposium on Parallel and Distributed Processing, IPDPS 2008., 2379-2386. Piscataway, New Jersey:IEEE. PNNL-SA-58480. doi:10.1109/IPDPS.2008.4536360