November 1, 2011
Journal Article

Big Data Ecosystems Enable Scientific Discovery

Abstract

Over the past 5 years, advances in experimental, sensor and computational technologies have driven the exponential growth in the volumes, acquisition rates, variety and complexity of scientific data. As noted by Hey et al in their 2009 e-book The Fourth Paradigm, this availability of large-quantities of scientifically meaningful data has given rise to a new scientific methodology – data intensive science. Data intensive science is the ability to formulate and evaluate hypotheses using data and analysis to extend, complement and, at times, replace experimentation, theory, or simulation. This new approach to science no longer requires scientists to interact directly with the objects of their research; instead they can utilize digitally captured, reduced, calibrated, analyzed, synthesized and visualized results – allowing them carry out “experiments” in data.

Revised: February 8, 2012 | Published: November 1, 2011

Citation

Critchlow T.J., and K. Kleese van Dam. 2011. Big Data Ecosystems Enable Scientific Discovery. HPC Source. PNNL-SA-83223.