Codesign for Extreme Heterogeneity: Integrating Custom Hardware with Commodity Computing Technology to Support Next-Generation HPC Converged Workloads
Abstract
The future of high-performance technical computing will be driven by the convergence of physical simulation, Artificial Intelligence (AI), Machine Learning (ML), and data science computing capabilities. While computational performance gains afforded by technology scaling, as predicted by Moore’s Law, have enabled large scale HPC system design and deployment using commodity CPU and GPU processing components, emerging technologies will be required to effectively support such converged workloads. These emerging technologies will integrate commodity computing components with custom processing and networking accelerators into ever-more heterogeneous architectures resulting in a diverse ecosystem of industry technology developers, university, and U.S. Government researchers. In this article, we describe efforts at the U.S. DOE Pacific Northwest National Laboratory (PNNL) to construct an end-to-end codesign framework to lay the groundwork for such an ecosystem, including notable outcomes, remaining challenges, and future opportunities.
Published: March 22, 2023
Citation
Ang J.A., K.J. Barker, D.L. Vrabie, and G. Kestor. 2023. Codesign for Extreme Heterogeneity: Integrating Custom Hardware with Commodity Computing Technology to Support Next-Generation HPC Converged Workloads. IEEE Internet Computing 27, no. 1:7 - 14. PNNL-SA-175408. doi:10.1109/MIC.2022.3217423