Slide for Sandia and Hill AFB ICBM Program Staff Discussions on UQ Considerations for Acquisition/Contracting
Abstract not provided.
Publications
Discrete-Direct Calibration Real Space Validation and Predictor-Corrector Extrapolation
Abstract not provided.
Experimental Data UQ and QMU from Sparse Unit Testing involving Variability and Uncertainties in Measurements Loading and System Properties
Abstract not provided.
Simple effective conservative treatment of uncertainty from sparse samples of random functions
ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems. Part B. Mechanical Engineering
This paper examines the variability of predicted responses when multiple stress-strain curves (reflecting variability from replicate material tests) are propagated through a finite element model of a ductile steel can being slowly crushed. Over 140 response quantities of interest (including displacements, stresses, strains, and calculated measures of material damage) are tracked in the simulations. Each response quantity’s behavior varies according to the particular stress-strain curves used for the materials in the model. We desire to estimate response variability when only a few stress-strain curve samples are available from material testing. Propagation of just a few samples will usually result in significantly underestimated response uncertainty relative to propagation of a much larger population that adequately samples the presiding random-function source. A simple classical statistical method, Tolerance Intervals, is tested for effectively treating sparse stress-strain curve data. The method is found to perform well on the highly nonlinear input-to-output response mappings and non-standard response distributions in the can-crush problem. The results and discussion in this paper support a proposition that the method will apply similarly well for other sparsely sampled random variable or function data, whether from experiments or models. Finally, the simple Tolerance Interval method is also demonstrated to be very economical.
Discrete-Direct Model Calibration and Propagation addressing Sparse Replicate Tests and Material Geometric and Measurement Uncertainties
Abstract not provided.
Discrete-Direct Model Calibration and Propagation Approach Addressing Sparse Replicate Tests and Material, Geometric, and Measurement Uncertainties
SAE Technical Papers
This paper introduces the "Discrete Direct" (DD) model calibration and uncertainty propagation approach for computational models calibrated to data from sparse replicate tests of stochastically varying systems. The DD approach generates and propagates various discrete realizations of possible calibration parameter values corresponding to possible realizations of the uncertain inputs and outputs of the experiments. This is in contrast to model calibration methods that attempt to assign or infer continuous probability density functions for the calibration parameters-which adds unjustified information to the calibration and propagation problem. The DD approach straightforwardly accommodates aleatory variabilities and epistemic uncertainties in system properties and behaviors, in input initial and boundary conditions, and in measurement uncertainties in the experiments. The approach appears to have several advantages over Bayesian and other calibration approaches for capturing and utilizing the information obtained from the typically small number of experiments in model calibration situations. In particular, the DD methodology better preserves the fundamental information from the experimental data in a way that enables model predictions to be more directly traced back to the supporting experimental data. The approach is also presently more viable for calibration involving sparse realizations of random function data (e.g. stress-strain curves) and random field data. The DD methodology is conceptually simpler than Bayesian calibration approaches, and is straightforward to implement. The methodology is demonstrated and analyzed in this paper on several illustrative calibration and uncertainty propagation problems.
A Class of Simple and Effective UQ Methods for Sparse Replicate Data applied to the Cantilever Beam End-to-End UQ Problem
Abstract not provided.
Evaluation of a Class of Simple and Effective Uncertainty Methods for Sparse Samples of Random Variables and Functions
When very few samples of a random quantity are available from a source distribution of unknown shape, it is usually not possible to accurately infer the exact distribution from which the data samples come. Under-estimation of important quantities such as response variance and failure probabilities can result. For many engineering purposes, including design and risk analysis, we attempt to avoid under-estimation with a strategy to conservatively estimate (bound) these types of quantities -- without being overly conservative -- when only a few samples of a random quantity are available from model predictions or replicate experiments. This report examines a class of related sparse-data uncertainty representation and inference approaches that are relatively simple, inexpensive, and effective. Tradeoffs between the methods' conservatism, reliability, and risk versus number of data samples (cost) are quantified with multi-attribute metrics use d to assess method performance for conservative estimation of two representative quantities: central 95% of response; and 10-4 probability of exceeding a response threshold in a tail of the distribution. Each method's performance is characterized with 10,000 random trials on a large number of diverse and challenging distributions. The best method and number of samples to use in a given circumstance depends on the uncertainty quantity to be estimated, the PDF character, and the desired reliability of bounding the true value. On the basis of this large data base and study, a strategy is proposed for selecting the method and number of samples for attaining reasonable credibility levels in bounding these types of quantities when sparse samples of random variables or functions are available from experiments or simulations.
A Class of Simple and Effective UQ Methods for Sparse Replicate Data applied to the Cantilever Beam End-to-End UQ Problem
Abstract not provided.
Validation Assessment of a Glass-to-Metal Seal Finite-Element Model
Sealing glasses are ubiquitous in high pressure and temperature engineering applications, such as hermetic feed-through electrical connectors. A common connector technology are glass-to-metal seals where a metal shell compresses a sealing glass to create a hermetic seal. Though finite-element analysis has been used to understand and design glass-to-metal seals for many years, there has been little validation of these models. An indentation technique was employed to measure the residual stress on the surface of a simple glass-to-metal seal. Recently developed rate- dependent material models of both Schott 8061 and 304L VAR stainless steel have been applied to a finite-element model of the simple glass-to-metal seal. Model predictions of residual stress based on the evolution of material models are shown. These model predictions are compared to measured data. Validity of the finite- element predictions is discussed. It will be shown that the finite-element model of the glass-to-metal seal accurately predicts the mean residual stress in the glass near the glass-to-metal interface and is valid for this quantity of interest.
Applicability Analysis of Validation Evidence for Biomedical Computational Models
Journal of Verification, Validation and Uncertainty Quantification
Computational modeling has the potential to revolutionize medicine the way it transformed engineering. However, despite decades of work, there has only been limited progress to successfully translate modeling research to patient care. One major difficulty which often occurs with biomedical computational models is an inability to perform validation in a setting that closely resembles how the model will be used. For example, for a biomedical model that makes in vivo clinically relevant predictions, direct validation of predictions may be impossible for ethical, technological, or financial reasons. Unavoidable limitations inherent to the validation process lead to challenges in evaluating the credibility of biomedical model predictions. Therefore, when evaluating biomedical models, it is critical to rigorously assess applicability, that is, the relevance of the computational model, and its validation evidence to the proposed context of use (COU). However, there are no well-established methods for assessing applicability. In this paper, we present a novel framework for performing applicability analysis and demonstrate its use with a medical device computational model. The framework provides a systematic, step-by-step method for breaking down the broad question of applicability into a series of focused questions, which may be addressed using supporting evidence and subject matter expertise. The framework can be used for model justification, model assessment, and validation planning. While motivated by biomedical models, it is relevant to a broad range of disciplines and underlying physics. Finally, the proposed applicability framework could help overcome some of the barriers inherent to validation of, and aid clinical implementation of, biomedical models.
Evaluation of Uncertainty Treatments for Sparse Samples of Random Variables and Functions
Abstract not provided.
Cantilever Beam End-to-End UQ Test Problem and Evaluation Criteria for UQ Methods Performance Assessment
Abstract not provided.
Analyst-to-Analyst Variability in Simulation-Based Prediction
This report describes findings from the culminating experiment of the LDRD project entitled, "Analyst-to-Analyst Variability in Simulation-Based Prediction". For this experiment, volunteer participants solving a given test problem in engineering and statistics were interviewed at different points in their solution process. These interviews are used to trace differing solutions to differing solution processes, and differing processes to differences in reasoning, assumptions, and judgments. The issue that the experiment was designed to illuminate -- our paucity of understanding of the ways in which humans themselves have an impact on predictions derived from complex computational simulations -- is a challenging and open one. Although solution of the test problem by analyst participants in this experiment has taken much more time than originally anticipated, and is continuing past the end of this LDRD, this project has provided a rare opportunity to explore analyst-to-analyst variability in significant depth, from which we derive evidence-based insights to guide further explorations in this important area.
Chapter 5: Uncertainty Quantification and Sensitivity Analysis?Some Fundamental Concepts Terminology Definitions and Relationships
Abstract not provided.
Chapter 11: Application of UQ and V&V to Experiments and Simulations of Heated Pipes Pressurized to Failure
Abstract not provided.
Chapter 10: An Introduction to Some Model Validation Concepts and Paradigms and the Real-Space Approach to Model Validation
Abstract not provided.
Evaluation of a Simple UQ Approach for Sparse Stress-Strain Curve Data in Solid Mechanics Applications
Abstract not provided.
Evaluation of a Simple UQ Approach to Compensate for Sparse Stress-Strain Curve Data in Solid Mechanics Applications
Abstract not provided.
A Survey of Probabilistic Uncertainty Propagation and Sensitivity Analysis Methods (Presentation)
Abstract not provided.
POF-Darts: Geometric adaptive sampling for probability of failure
Reliability Engineering and System Safety
We introduce a novel technique, POF-Darts, to estimate the Probability Of Failure based on random disk-packing in the uncertain parameter space. POF-Darts uses hyperplane sampling to explore the unexplored part of the uncertain space. We use the function evaluation at a sample point to determine whether it belongs to failure or non-failure regions, and surround it with a protection sphere region to avoid clustering. We decompose the domain into Voronoi cells around the function evaluations as seeds and choose the radius of the protection sphere depending on the local Lipschitz continuity. As sampling proceeds, regions uncovered with spheres will shrink, improving the estimation accuracy. After exhausting the function evaluation budget, we build a surrogate model using the function evaluations associated with the sample points and estimate the probability of failure by exhaustive sampling of that surrogate. In comparison to other similar methods, our algorithm has the advantages of decoupling the sampling step from the surrogate construction one, the ability to reach target POF values with fewer samples, and the capability of estimating the number and locations of disconnected failure regions, not just the POF value. We present various examples to demonstrate the efficiency of our novel approach.
Thoughts and Developments toward the ?2nd Law? of Modeling and Simulation and its Implications
Abstract not provided.
EXPERIMENTAL DATA UNCERTAINTY CALIBRATION AND VALIDATION OF A VISCOELASTIC POTENTIAL ENERGY CLOCK MODEL FOR INORGANIC SEALING GLASSES
Abstract not provided.
Design of Experiments for Uncertainty Quantification on Sparsely Sampled Discrete Random Functions in Multiple Dimensions
Abstract not provided.
Can-Crush Model and Simulations for Verifying Uncertainty Quantification Method for Sparse Stress-Strain Curve Data
Abstract not provided.
Results 26–50 of 126