As the field of deep learning has emerged in recent years, the amount of knowledge and expertise that data scientists are expected to absorb and maintain has correspondingly increased. One of the challenges experienced by data scientists working with deep learning models is developing confidence in the accuracy of their approach and the resulting findings. In this study, we conducted semi-structured interviews with data scientists at a National Laboratory to understand the processes that data scientists use when attempting to develop their models and the ways that they gain confidence that the results they obtained were accurate. These interviews were analysed to provide an overview of the techniques currently used when working with machine learning (ML) models and opportunities for collaboration with human factors researchers to develop new tools are identified.
Published: July 25, 2023
Citation
Baweja J.A., B.A. Jefferson, and C. Fallon. 2023.Developing Confidence in Machine Learning Results. In Human Factors and Simulation. International Conference on Applied Human Factors and Ergonomics (AHFE 2023), July 20-24, 2023, San Francisco, CA, edited by J. Wright and D. Barber, 83, 184–191. New York, New York:Applied Human Factors and Ergonomics International.PNNL-SA-181613.doi:10.54941/ahfe1003576