Publications

Results 26–50 of 70

Search results

Jump to search filters

Confronting Domain Shift in Trained Neural Networks

Proceedings of Machine Learning Research

Martinez, Carianne M.; Najera-Flores, David A.; Brink, Adam R.; Quinn, D.D.; Chatzi, Eleni; Forrest, Stephanie

Neural networks (NNs) are known as universal function approximators and can interpolate nonlinear functions between observed data points. However, when the target domain for deployment shifts from the training domain and NNs must extrapolate, the results are notoriously poor. Prior work Martinez et al. (2019) has shown that NN uncertainty estimates can be used to correct binary predictions in shifted domains without retraining the model. We hypothesize that this approach can be extended to correct real-valued time series predictions. As an exemplar, we consider two mechanical systems with nonlinear dynamics. The first system consists of a spring-mass system where the stiffness changes abruptly, and the second is a real experimental system with a frictional joint that is an open challenge for structural dynamicists to model efficiently. Our experiments will test whether 1) NN uncertainty estimates can identify when the input domain has shifted from the training domain and 2) whether the information used to calculate uncertainty estimates can be used to correct the NN’s time series predictions. While the method as proposed did not significantly improve predictions, our results did show potential for modifications that could improve models’ predictions and play a role in structural health monitoring systems that directly impact public safety.

More Details
TYPE Journal Article YEAR 2021
OSTI

Confronting Domain Shift in Trained Neural Networks

Proceedings of Machine Learning Research

Martinez, Carianne M.; Najera-Flores, David A.; Brink, Adam R.; Quinn, D.D.; Chatzi, Eleni; Forrest, Stephanie

Neural networks (NNs) are known as universal function approximators and can interpolate nonlinear functions between observed data points. However, when the target domain for deployment shifts from the training domain and NNs must extrapolate, the results are notoriously poor. Prior work Martinez et al. (2019) has shown that NN uncertainty estimates can be used to correct binary predictions in shifted domains without retraining the model. We hypothesize that this approach can be extended to correct real-valued time series predictions. As an exemplar, we consider two mechanical systems with nonlinear dynamics. The first system consists of a spring-mass system where the stiffness changes abruptly, and the second is a real experimental system with a frictional joint that is an open challenge for structural dynamicists to model efficiently. Our experiments will test whether 1) NN uncertainty estimates can identify when the input domain has shifted from the training domain and 2) whether the information used to calculate uncertainty estimates can be used to correct the NN’s time series predictions. While the method as proposed did not significantly improve predictions, our results did show potential for modifications that could improve models’ predictions and play a role in structural health monitoring systems that directly impact public safety.

More Details
TYPE Conference Paper YEAR 2021
OSTIScopus

Physics-Informed Machine Learning for Epidemiological Models

Martinez, Carianne M.; Jones, Jessica E.; Levin, Drew L.; Trask, Nathaniel A.; Finley, Patrick D.

One challenge of using compartmental SEIR models for public health planning is the difficulty in manually tuning parameters to capture behavior reflected in the real-world data. This team conducted initial, exploratory analysis of a novel technique to use physics-informed machine learning tools to rapidly develop data-driven models for physical systems. This machine learning approach may be used to perform data assimilation of compartment models which account for unknown interactions between geospatial domains (i.e. diffusion processes coupling across neighborhoods/counties/states/etc.). Results presented here are early, proof-of-concept ideas that demonstrate initial success in using a physically informed neural network (PINN) model to assimilate data in a compartmental epidemiology model. The results demonstrate initial success and warrant further research and development.

More Details
TYPE Other Report YEAR 2020
DOIOSTI

Automated Segmentation of Porous Thermal Spray Material CT Scans with Geometric Uncertainty Estimation

Martinez, Carianne M.; Bolintineanu, Dan S.; Olson, Aaron J.; Rodgers, Theron R.; Donohoe, Brendan D.; Potter, Kevin M.; Roberts, Scott A.; Moore, Nathan W.

Thermal sprayed metal coatings are used in many industrial applications, and characterizing the structure and performance of these materials is vital to understanding their behavior in the field. X-ray Computed Tomography (CT) machines enable volumetric, nondestructive imaging of these materials, but precise segmentation of this grayscale image data into discrete material phases is necessary to calculate quantities of interest related to material structure. In this work, we present a methodology to automate the CT segmentation process as well as quantify uncertainty in segmentations via deep learning. Neural networks (NNs) are shown to accurately segment full resolution CT scans of thermal sprayed materials and provide maps of uncertainty that conservatively bound the predicted geometry. These bounds are propagated through calculations of material properties such as porosity that may provide an understanding of anticipated behavior in the field.

More Details
TYPE SAND Report YEAR 2020
DOIOSTI
Results 26–50 of 70
Results 26–50 of 70