Global cloud resolving models at 4km resolutions or less create significant challenges in generation of simulation data, data storage, data management, and post-simulation analysis and visualization. To support efficient model output as well as data analysis, new models for IO and data organization must be evaluated. The model we are supporting, the Global Cloud Resolving Model being developed at Colorado State University, uses a geodesic grid. The non-monotonic nature of the grid's coordinate variables requires enhancements to existing data processing tools and community standards for describing and manipulating grids. The resolution, size and extent of the data suggest the need for parallel analysis tools and allow for the possibility of new techniques in data mining, filtering and comparison to observations. We describe the challenges posed by various aspects of data generation, management, and analysis, our work exploring IO strategies for the model, and a preliminary architecture, web portal, and tool enhancements which, when complete, will enable broad community access to the data sets in a way that is familiar to the community.
Revised: January 21, 2008 |
Published: December 1, 2007
Citation
Schuchardt K.L., B.J. Palmer, J. Daily, T.O. Elsethagen, and A.S. Koontz. 2007.IO strategies and data services for petascale data sets from a global cloud resolving model.Journal of Physics: Conference Series 78.PNNL-SA-55926.doi:10.1088/1742-6596/78/1/012089