Skip to main content

PNNL

  • About
  • News & Media
  • Careers
  • Events
  • Research
    • Scientific Discovery
      • Biology
        • Chemical Biology
        • Computational Biology
        • Ecosystem Science
        • Human Health
          • Cancer Biology
          • Exposure Science & Pathogen Biology
        • Integrative Omics
          • Advanced Metabolomics
          • Chemical Biology
          • Mass Spectrometry-Based Measurement Technologies
          • Spatial and Single-Cell Proteomics
          • Structural Biology
        • Microbiome Science
          • Biofuels & Bioproducts
          • Human Microbiome
          • Soil Microbiome
          • Synthetic Biology
        • Predictive Phenomics
      • Chemistry
        • Computational Chemistry
        • Chemical Separations
        • Chemical Physics
        • Catalysis
      • Earth & Coastal Sciences
        • Global Change
        • Atmospheric Science
          • Atmospheric Aerosols
          • Human-Earth System Interactions
          • Modeling Earth Systems
        • Coastal Science
        • Ecosystem Science
        • Subsurface Science
        • Terrestrial Aquatics
      • Materials Sciences
        • Materials in Extreme Environments
        • Precision Materials by Design
        • Science of Interfaces
        • Solid Phase Processing
          • Cold Spray
          • Friction Stir Welding & Processing
          • ShAPE
      • Nuclear & Particle Physics
        • Dark Matter
        • Flavor Physics
        • Fusion Energy Science
        • Neutrino Physics
      • Quantum Information Sciences
    • Energy Resiliency
      • Electric Grid Modernization
        • Emergency Response
        • Grid Analytics
          • AGM Program
          • Tools and Capabilities
        • Grid Architecture
        • Grid Cybersecurity
        • Grid Energy Storage
        • Grid Resilience and Decarbonization
          • Earth System Modeling
          • Energy System Modeling
        • Transmission
        • Distribution
      • Energy Efficiency
        • Appliance and Equipment Standards
        • Building Energy Codes
        • Building Technologies
          • Advanced Building Controls
          • Advanced Lighting
          • Building-Grid Integration
        • Building and Grid Modeling
        • Commercial Buildings
        • Federal Buildings
          • Federal Performance Optimization
          • Resilience and Security
        • Grid Resilience and Decarbonization
        • Residential Buildings
          • Building America Solution Center
          • Energy Efficient Technology Integration
          • Home Energy Score
        • Energy Efficient Technology Integration
      • Energy Storage
        • Electrochemical Energy Storage
        • Flexible Loads and Generation
        • Grid Integration, Controls, and Architecture
        • Regulation, Policy, and Valuation
        • Science Supporting Energy Storage
        • Chemical Energy Storage
      • Environmental Management
        • Waste Processing
        • Radiation Measurement
        • Environmental Remediation
      • Fossil Energy
        • Subsurface Energy Systems
        • Carbon Management
          • Carbon Capture
          • Carbon Storage
          • Carbon Utilization
        • Advanced Hydrocarbon Conversion
      • Nuclear Energy
        • Fuel Cycle Research
        • Advanced Reactors
        • Reactor Operations
        • Reactor Licensing
      • Renewable Energy
        • Solar Energy
        • Wind Energy
          • Wind Resource Characterization
          • Wildlife and Wind
          • Community Values and Ocean Co-Use
          • Wind Systems Integration
          • Wind Data Management
          • Distributed Wind
        • Marine Energy
          • Environmental Monitoring for Marine Energy
          • Marine Biofouling and Corrosion
          • Marine Energy Resource Characterization
          • Testing for Marine Energy
          • The Blue Economy
        • Hydropower
          • Environmental Performance of Hydropower
          • Hydropower Cybersecurity and Digitalization
          • Hydropower and the Electric Grid
          • Materials Science for Hydropower
          • Pumped Storage Hydropower
          • Water + Hydropower Planning
        • Grid Integration of Renewable Energy
        • Geothermal Energy
      • Transportation
        • Bioenergy Technologies
          • Algal Biofuels
          • Aviation Biofuels
          • Waste-to-Energy and Products
        • Hydrogen & Fuel Cells
        • Vehicle Technologies
          • Emission Control
          • Energy-Efficient Mobility Systems
          • Lightweight Materials
          • Vehicle Electrification
          • Vehicle Grid Integration
    • National Security
      • Chemical & Biothreat Signatures
        • Contraband Detection
        • Pathogen Science & Detection
        • Explosives Detection
        • Threat-Agnostic Biodefense
      • Cybersecurity
        • Discovery and Insight
        • Proactive Defense
        • Trusted Systems
      • Nuclear Material Science
      • Nuclear Nonproliferation
        • Radiological & Nuclear Detection
        • Nuclear Forensics
        • Ultra-Sensitive Nuclear Measurements
        • Nuclear Explosion Monitoring
        • Global Nuclear & Radiological Security
      • Stakeholder Engagement
        • Disaster Recovery
        • Global Collaborations
        • Legislative and Regulatory Analysis
        • Technical Training
      • Systems Integration & Deployment
        • Additive Manufacturing
        • Deployed Technologies
        • Rapid Prototyping
        • Systems Engineering
      • Threat Analysis
        • Advanced Wireless Security
          • 5G Security
          • RF Signal Detection & Exploitation
        • Grid Resilience and Decarbonization
        • Internet of Things
        • Maritime Security
        • Millimeter Wave
        • Mission Risk and Resilience
    • Data Science & Computing
      • Artificial Intelligence
      • Graph and Data Analytics
      • Software Engineering
      • Computational Mathematics & Statistics
      • Future Computing Technologies
        • Adaptive Autonomous Systems
      • Visual Analytics
    • Publications & Reports
    • Featured Research
  • People
    • Inventors
    • Lab Leadership
    • Lab Fellows
    • Staff Accomplishments
  • Partner with PNNL
    • Education
      • Undergraduate Students
      • Graduate Students
      • Post-graduate Students
      • University Faculty
      • University Partnerships
      • K-12 Educators and Students
      • STEM Education
        • STEM Workforce Development
        • STEM Outreach
        • Meet the Team
      • Internships
    • Community
      • Regional Impact
      • Philanthropy
      • Volunteering
    • Industry
      • Available Technologies
      • Industry
      • Industry Partnerships
      • Licensing & Technology Transfer
      • Entrepreneurial Leave
      • Visual Intellectual Property Search (VIPS)
  • Facilities & Centers
    • All Facilities
      • Atmospheric Radiation Measurement User Facility
      • Electricity Infrastructure Operations Center
      • Energy Sciences Center
      • Environmental Molecular Sciences Laboratory
      • Grid Storage Launchpad
      • Institute for Integrated Catalysis
      • Interdiction Technology and Integration Laboratory
      • PNNL Portland Research Center
      • PNNL Seattle Research Center
      • PNNL-Sequim (Marine and Coastal Research)
      • Radiochemical Processing Laboratory
      • Shallow Underground Laboratory

Physics-Informed Learning Machines for Multiscale and Multiphysics Problems

  • News
    • Webinars
    • Past Conferences
  • Research
  • Team
  • Publications
    • Presentations
    • Keynotes
  • Software
  • Outreach/Internships

Breadcrumb

  1. Home
  2. Projects
  3. Physics-Informed Learning Machines for Multiscale and Multiphysics Problems

Software

Software Catalog

 

DeepXDE

DeepXDE: A Deep Learning Library for Solving Differential Equations

Deep learning has achieved remarkable success in diverse applications; however, its use in solving partial differential equations (PDEs) has emerged only recently. Here, we present an overview of physics-informed neural networks (PINNs), which embed a PDE into the loss of the neural network using automatic differentiation. The PINN algorithm is simple, and it can be applied to different types of PDEs, including integro- differential equations, fractional PDEs, and stochastic PDEs. Moreover, from the implementation point of view, PINNs solve inverse problems as easily as forward problems. We propose a new residual-based adaptive refinement (RAR) method to improve the training efficiency of PINNs. For pedagogical reasons, we compare the PINN algorithm to a standard finite element method. We also present a Python library for PINNs, DeepXDE, which is designed to serve both as an education tool to be used in the classroom as well as a research tool for solving problems in computational science and engineering. Specifically, DeepXDE can solve forward problems given initial and boundary conditions, as well as inverse problems given some extra measurements. DeepXDE supports complex-geometry domains based on the technique of constructive solid geometry, and enables the user code to be compact, resembling closely the mathematical formulation. We introduce the usage of DeepXDE and its customizability, and we also demonstrate the capability of PINNs and the user-friendliness of DeepXDE for five different examples. More broadly, DeepXDE contributes to the more rapid development of the emerging Scientific Machine Learning field.

DeepXDE is a deep learning library for solving differential equations on top of TensorFlow. More details found in the documentation.

Total downloads: 56,000 as of September 2020

  • PyPI
  • Anaconda

 

LAMMPS MD Package

MANGO-SELM

USER-SELM: Fluctuating Hydrodynamics Simulations in LAMMPS

The USER-SELM package provides fluctuating hydrodynamics capabilities for LAMMPS for simulating fluid-structure interactions subject to thermal fluctuations based on stochastic continuum fields (SPDEs). The pack-age provides a variety of time-step integrators for different physical regimes for implicit-solvent coarse-grained simulations, stochastic immersed boundary methods, and other stochastic eulerian lagrangian methods (SELMs). Work was done on a major re-working of the C++ back-end of the package to operate with the LAMMPS shear functionality to facilitate rheological studies of complex fluids and soft materials, and for better integration with machine learning methods. An interface was developed for using SELM package from Python and within Jupyter notebooks. This new release was accompanied with new tutorial videos, example scripts, and notebooks on webpage: http://mango-selm.org/. This work was also presented as an extended session as part of the 2021 LAMMPS Workshop https://www.lammps.org/workshops/Aug21/.

MLMOD

USER-MLMOD

For machine learning (ML) modeling (MOD) in LAMMPS, we also developed a new package called USER-MLMOD to provide ways in SELM and other simulations to deploy machine learning models. This includes deep neural network representations for microstructure interactions and dynamics. This also includes functionality related to our VAE methods for learning non-linear dynamics. This package allows for our learned models to be used as (i) time-step integrators, (ii) interactions within LAMMPS, and (ii) to compute quantities-of-interest. This facilitates the practical use of our learned reduced-order models in application domain simulations. Our package is developed in C++ and interfaces with machine learning libraries. This work was presented at the 2021 LAMMPS Workshop.

 

ACDME Summary Flow Chart
Photo courtesy of Stanford University.

ADCME Library (Automatic Differentiation Library for Computational and Mathematical Engineering)

New Version available (v0.5.1) for download at:

  • ADCME.jl
  • AdFem.jl: Inverse Modeling with the Finite Element Method
  • ADSeismic.jl: Inverse Problems in Earthquake Location/Source-Time Function, FWI, Rupture Process
  • FwiFlow.jl: Seismic Inversion, Two-Phase Flow, Coupled Seismic and Flow Equations

Documentation also available.

 

GMLS Layer Chart
Photo courtesy of UCSB

GMLS-Nets: A Framework for Learning from Unstructured Data

N. Trask, R. G. Patel, B. J. Gross, and P. J. Atzberger

  • PyTorch
  • TensorFlow

 

 

 

 

 

Additional Software Releases:

  • BBFMM: Generalized Fast Multipole Method
  • cvPINNs
  • MOR-Physics
  • pyPCGA: Python Library for Principal Component Geostatistical Approach
  • SinkhornSSL: Software for Semi-Supervised Learning, Based on ICML paper Sinkhorn Label Allocation: Semi-Supervised Classification via Annealed Self-Training
  • SpaND: Fast Linear Solver for Large-Scale Sparse Linear Systems
  • TaskTorrent: Parallel Runtime Library for Executing Concurrent Directed Acyclic Graphs of Computational Tasks with a Focus on a Very Low-Overhead when Executing Micro-Tasks

 

Legacy software created through the PhILMs project:

  • ADSeismic v0.2.0
  • FwiFlow v0.2.0
  • NNFEM v0.1.0

Visit the CM4 site for more legacy software.

PNNL

  • Get in Touch
    • Contact
    • Careers
    • Doing Business
    • Environmental Reports
    • Security & Privacy
    • Vulnerability Disclosure Policy
  • Research
    • Scientific Discovery
    • Energy Resiliency
    • National Security
Subscribe to PNNL News
Department of Energy Logo Battelle Logo
Pacific Northwest National Laboratory (PNNL) is managed and operated by Battelle for the Department of Energy
  • YouTube
  • Facebook
  • X (formerly Twitter)
  • Instagram
  • LinkedIn