Skip to main content

PNNL

  • About
  • News & Media
  • Careers
  • Events
  • Research
    • Scientific Discovery
      • Biology
        • Chemical Biology
        • Computational Biology
        • Ecosystem Science
        • Human Health
          • Cancer Biology
          • Exposure Science & Pathogen Biology
        • Integrative Omics
          • Advanced Metabolomics
          • Chemical Biology
          • Mass Spectrometry-Based Measurement Technologies
          • Spatial and Single-Cell Proteomics
          • Structural Biology
        • Microbiome Science
          • Biofuels & Bioproducts
          • Human Microbiome
          • Soil Microbiome
          • Synthetic Biology
        • Predictive Phenomics
      • Chemistry
        • Computational Chemistry
        • Chemical Separations
        • Chemical Physics
        • Catalysis
      • Earth & Coastal Sciences
        • Global Change
        • Atmospheric Science
          • Atmospheric Aerosols
          • Human-Earth System Interactions
          • Modeling Earth Systems
        • Coastal Science
        • Ecosystem Science
        • Subsurface Science
        • Terrestrial Aquatics
      • Materials Sciences
        • Materials in Extreme Environments
        • Precision Materials by Design
        • Science of Interfaces
        • Solid Phase Processing
          • Cold Spray
          • Friction Stir Welding & Processing
          • ShAPE
      • Nuclear & Particle Physics
        • Dark Matter
        • Fusion Energy Science
        • Neutrino Physics
      • Quantum Information Sciences
    • Energy Resiliency
      • Electric Grid Modernization
        • Emergency Response
        • Grid Analytics
          • AGM Program
          • Tools and Capabilities
        • Grid Architecture
        • Grid Cybersecurity
        • Grid Energy Storage
        • Transmission
        • Distribution
      • Energy Efficiency
        • Appliance and Equipment Standards
        • Building Energy Codes
        • Building Technologies
          • Advanced Building Controls
          • Advanced Lighting
          • Building-Grid Integration
        • Building and Grid Modeling
        • Commercial Buildings
        • Federal Buildings
          • Federal Performance Optimization
          • Resilience and Security
        • Residential Buildings
          • Building America Solution Center
          • Energy Efficient Technology Integration
          • Home Energy Score
        • Energy Efficient Technology Integration
      • Energy Storage
        • Electrochemical Energy Storage
        • Flexible Loads and Generation
        • Grid Integration, Controls, and Architecture
        • Regulation, Policy, and Valuation
        • Science Supporting Energy Storage
        • Chemical Energy Storage
      • Environmental Management
        • Waste Processing
        • Radiation Measurement
        • Environmental Remediation
      • Fossil Energy
        • Subsurface Energy Systems
        • Carbon Management
          • Carbon Capture
          • Carbon Storage
          • Carbon Utilization
        • Advanced Hydrocarbon Conversion
      • Nuclear Energy
        • Fuel Cycle Research
        • Advanced Reactors
        • Reactor Operations
        • Reactor Licensing
      • Renewable Energy
        • Solar Energy
        • Wind Energy
          • Wind Resource Characterization
          • Wildlife and Wind
          • Community Values and Ocean Co-Use
          • Wind Systems Integration
          • Wind Data Management
          • Distributed Wind
        • Marine Energy
          • Environmental Monitoring for Marine Energy
          • Marine Biofouling and Corrosion
          • Marine Energy Resource Characterization
          • Testing for Marine Energy
          • The Blue Economy
        • Hydropower
          • Environmental Performance of Hydropower
          • Hydropower Cybersecurity and Digitalization
          • Hydropower and the Electric Grid
          • Materials Science for Hydropower
          • Pumped Storage Hydropower
          • Water + Hydropower Planning
        • Grid Integration of Renewable Energy
        • Geothermal Energy
      • Transportation
        • Bioenergy Technologies
          • Algal Biofuels
          • Aviation Biofuels
          • Waste-to-Energy and Products
        • Hydrogen & Fuel Cells
        • Vehicle Technologies
          • Emission Control
          • Energy-Efficient Mobility Systems
          • Lightweight Materials
          • Vehicle Electrification
          • Vehicle Grid Integration
    • National Security
      • Chemical & Biothreat Signatures
        • Contraband Detection
        • Pathogen Science & Detection
        • Explosives Detection
        • Threat-Agnostic Biodefense
      • Cybersecurity
        • Discovery and Insight
        • Proactive Defense
        • Trusted Systems
      • Nuclear Material Science
      • Nuclear Nonproliferation
        • Radiological & Nuclear Detection
        • Nuclear Forensics
        • Ultra-Sensitive Nuclear Measurements
        • Nuclear Explosion Monitoring
        • Global Nuclear & Radiological Security
      • Stakeholder Engagement
        • Disaster Recovery
        • Global Collaborations
        • Legislative and Regulatory Analysis
        • Technical Training
      • Systems Integration & Deployment
        • Additive Manufacturing
        • Deployed Technologies
        • Rapid Prototyping
        • Systems Engineering
      • Threat Analysis
        • Advanced Wireless Security
          • 5G Security
          • RF Signal Detection & Exploitation
        • Internet of Things
        • Maritime Security
        • Millimeter Wave
        • Mission Risk and Resilience
    • Data Science & Computing
      • Artificial Intelligence
      • Graph and Data Analytics
      • Software Engineering
      • Computational Mathematics & Statistics
      • Future Computing Technologies
        • Adaptive Autonomous Systems
    • Publications & Reports
    • Featured Research
  • People
    • Inventors
    • Lab Leadership
    • Lab Fellows
    • Staff Accomplishments
  • Partner with PNNL
    • Education
      • Undergraduate Students
      • Graduate Students
      • Post-graduate Students
      • University Faculty
      • University Partnerships
      • K-12 Educators and Students
      • STEM Education
        • STEM Workforce Development
        • STEM Outreach
        • Meet the Team
      • Internships
    • Community
      • Regional Impact
      • Philanthropy
      • Volunteering
    • Industry
      • Available Technologies
      • Industry
      • Industry Partnerships
      • Licensing & Technology Transfer
      • Entrepreneurial Leave
      • Visual Intellectual Property Search (VIPS)
  • Facilities & Centers
    • All Facilities
      • Atmospheric Radiation Measurement User Facility
      • Electricity Infrastructure Operations Center
      • Energy Sciences Center
      • Environmental Molecular Sciences Laboratory
      • Grid Storage Launchpad
      • Institute for Integrated Catalysis
      • Interdiction Technology and Integration Laboratory
      • PNNL Portland Research Center
      • PNNL Seattle Research Center
      • PNNL-Sequim (Marine and Coastal Research)
      • Radiochemical Processing Laboratory
      • Shallow Underground Laboratory

QA/QC Appendix A

Guidance for Designing, Developing, Testing, and Implementing Environmental Software Systems

For each new or modified system or module, the project team follows the general process described below. Each step in the process has its own guidance to project staff.

Step 1 -- Requirements Analysis (Section 3.1)

step 1

The subject matter expert (SME) leads team members in determining what the requirements are for the module or framework. The resulting requirements package should list requirements in general categories, breaking each category down into sufficient detail that the custodians and code developers will clearly understand what is expected as an outcome for the software. This breakdown can be documented in the form of an outline or work breakdown structure. When the requirements package is completed, the subject matter expert provides a copy to the project custodian and the module or framework custodian.

Step 2-Step 4 -- System Design and Development (Section 3.2)

Step 2

step 2

The framework or module custodian (depending on whether a framework or module is being developed) leads the code developers in determining what kinds of software components and coding must be developed to meet the requirements. Every requirement level and sub-level should be addressed. The requirements can be addressed using a matrix that lists software components or processes next to requirement or in a database that connects correlates requirements with design elements. These design elements should be specified sufficiently clearly to allow understanding by all members of the development team.

Step 3

step 3

The subject matter expert(SME) and framework or module custodian (depending on whether a framework or module is being developed) meet to confirm relationships between and the "whats" and the "hows". At this time the subject matter expert and custodian decide on a ranking of both the requirements and related design elements to ensure the development process addresses the more critical items before others. This information is added to the software development package and the database that was used to match the requirements and design elements previously. 

Step 4

step 4

The framework or module custodian (depending on whether a framework or module is being developed) reviews the design elements confirmed by the subject matter expert (SME) in Step 3 to determine whether they are dependent, have positive relationships, or are mutually exclusive and therefore, likely cause difficulties in implementation. This information is also added to the software development package and the database that was used to match the requirements and elements previously. In addition, at this point, the framework or module custodian should address the finer points of the design for the software development package. The process of evaluating the current set of design elements by asking the question "how will each of these elements be address?" is often used to breakdown the design into workable sections that can then be assigned to code developers.

Step 5 -- System Integration, Testing, and Evaluation (Section 5.0)

step 5

The application expert leads the testers and technical reviewers in answering the question: "How will we know the software works?" They focus on both the design elements and the requirements, allowing both to be tested. The test package may contain the following information:

Step 6 -- System Design and Development (Section 3.2)

step 6

The framework developers implement the design elements identified in previous steps. When finished, they complete the software development package.

Step 7 -- System Integration, Testing, and Evaluation (Section 5.0)
 
step 7

The application expert leads the testers and technical reviewers in running the tests and determining whether the results are acceptable in ensuring that the software will meet client requirements. The results of the tests and any modifications made to the module or framework as a result of the tests are included in the development package and software test package then submitted to the project custodian.

Step 8 -- System Implementation (Section 6.0)

step 8

The subject matter expert is responsible for determining if the software is ready to be delivered to the client. This involved confirming the completeness of the requirements package, the development package, and the software test package. Any technology transfer, implementation support, and training are determined and implemented in this step. 

Throughout the above Steps additional information or clarification can send the process back to any previous step. From that entry point, however, the steps must be completed in order. For example, an additional client need identified in step 7 will send the team back to enhance the existing information in Step 1. From there the team will progress to Step 2, 3 and so on. Although the process is defined the time spent in each step is determined by the additional information and its affects on the software system. This approach will allow for the flexibility of accepting additional information with the traceability of a well defined process.

PNNL-11880

PNNL

  • Get in Touch
    • Contact
    • Careers
    • Doing Business
    • Environmental Reports
    • Security & Privacy
    • Vulnerability Disclosure Policy
  • Research
    • Scientific Discovery
    • Energy Resiliency
    • National Security
Subscribe to PNNL News
Department of Energy Logo Battelle Logo
Pacific Northwest National Laboratory (PNNL) is managed and operated by Battelle for the Department of Energy
  • YouTube
  • Facebook
  • X (formerly Twitter)
  • Instagram
  • LinkedIn