Theoretical Framework for Hardware-in-the-Loop (HiL)
Provide a theoretical framework to support the design and execution of HiL experiments for the investigation of systems and their characteristics under adverse conditions.
PI: Kristine Arthur-Durett, kristine.arthur-durett@pnnl.gov
This project will develop a high-fidelity experimental design theory and execution framework to conduct experiments that employ the initiative use cases. This framework is needed to provide scientific validity that the experimental results are provable and will apply in the real world.
In FY 2021, this project developed an initial methodology to describe measures and metrics to quantify fidelity of an experimental setup. This definition includes transparency of the simulation, which allows users to only model the coupling system, removing the need for a ground truth comparison. An initial study was performed using an existing dataset of faults and cyber-attacks on modeled electrical distribution systems for measuring Intrusion Detection System performance. In addition, this project started to explore understanding the uncertainties in simulated models and metrics in the frequency domain to validate them.
In FY 2022, this project plans to develop mapping between the fidelity framework and the compositions of experimental infrastructure being used by the initiative. This mapping will allow researchers to determine the necessary elements in an experiment to meet their objectives. In addition, the project will develop a guidance tool, likely a worksheet, to support researchers in understanding their required fidelity level to answer their proposed research questions and determine the appropriate experimentation platform.
- Goal I: Provide formal framework for researchers to evaluate the level of fidelity needed to achieve their objectives.
- Goal II: Develop mapping between fidelity, generality, and experimental infrastructure to allow researchers to determine the elements necessary for their objectives.