Publications

Results 1–25 of 46

Search results

Jump to search filters

Benchmarking the PCMCI Causal Discovery Algorithm for Spatiotemporal Systems

Nichol, Jeffrey N.; Weylandt, Michael; Smith, Mark A.; Swiler, Laura P.

Causal discovery algorithms construct hypothesized causal graphs that depict causal dependencies among variables in observational data. While powerful, the accuracy of these algorithms is highly sensitive to the underlying dynamics of the system in ways that have not been fully characterized in the literature. In this report, we benchmark the PCMCI causal discovery algorithm in its application to gridded spatiotemporal systems. Effectively computing grid-level causal graphs on large grids will enable analysis of the causal impacts of transient and mobile spatial phenomena in large systems, such as the Earth’s climate. We evaluate the performance of PCMCI with a set of structural causal models, using simulated spatial vector autoregressive processes in one- and two-dimensions. We develop computational and analytical tools for characterizing these processes and their associated causal graphs. Our findings suggest that direct application of PCMCI is not suitable for the analysis of dynamical spatiotemporal gridded systems, such as climatological data, without significant preprocessing and downscaling of the data. PCMCI requires unrealistic sample sizes to achieve acceptable performance on even modestly sized problems and suffers from a notable curse of dimensionality. This work suggests that, even under generous structural assumptions, significant additional algorithmic improvements are needed before causal discovery algorithms can be reliably applied to grid-level outputs of earth system models.

More Details

Decision Science for Machine Learning (DeSciML)

Darling, Michael C.; Field, Richard V.; Smith, Mark A.; Doak, Justin E.; Headen, James M.; Stracuzzi, David J.

The increasing use of machine learning (ML) models to support high-consequence decision making drives a need to increase the rigor of ML-based decision making. Critical problems ranging from climate change to nonproliferation monitoring rely on machine learning for aspects of their analyses. Likewise, future technologies, such as incorporation of data-driven methods into the stockpile surveillance and predictive failure analysis for weapons components, will all rely on decision-making that incorporates the output of machine learning models. In this project, our main focus was the development of decision scientific methods that combine uncertainty estimates for machine learning predictions, with a domain-specific model of error costs. Other focus areas include uncertainty measurement in ML predictions, designing decision rules using multiobjecive optimization, the value of uncertainty reduction, and decision-tailored uncertainty quantification for probability estimates. By laying foundations for rigorous decision making based on the predictions of machine learning models, these approaches are directly relevant to every national security mission that applies, or will apply, machine learning to data, most of which entail some decision context.

More Details

Complex Systems Models and Their Applications: Towards a New Science of Verification, Validation & Uncertainty Quantification

Tsao, Jeffrey Y.; Trucano, Timothy G.; Kleban, S.D.; Naugle, Asmeret B.; Verzi, Stephen J.; Swiler, Laura P.; Johnson, Curtis M.; Smith, Mark A.; Flanagan, Tatiana P.; Vugrin, Eric D.; Gabert, Kasimir G.; Lave, Matthew S.; Chen, Wei; Delaurentis, Daniel; Hubler, Alfred; Oberkampf, Bill

This report contains the written footprint of a Sandia-hosted workshop held in Albuquerque, New Mexico, June 22-23, 2016 on “Complex Systems Models and Their Applications: Towards a New Science of Verification, Validation and Uncertainty Quantification,” as well as of pre-work that fed into the workshop. The workshop’s intent was to explore and begin articulating research opportunities at the intersection between two important Sandia communities: the complex systems (CS) modeling community, and the verification, validation and uncertainty quantification (VVUQ) community The overarching research opportunity (and challenge) that we ultimately hope to address is: how can we quantify the credibility of knowledge gained from complex systems models, knowledge that is often incomplete and interim, but will nonetheless be used, sometimes in real-time, by decision makers?

More Details

Holistic Portfolio Optimization using Directed Mutations

Henry, Stephen M.; Smith, Mark A.; Eddy, John P.

Genetic algorithms provide attractive options for performing nonlinear multi-objective combinatorial design optimization, and they have proven very useful for optimizing individual systems. However, conventional genetic algorithms fall short when performing holistic portfolio optimizations in which the decision variables also include the integer counts of multiple system types over multiple time periods. When objective functions are formulated as analytic functions, we can formally differentiate with respect to system counts and use the resulting gradient information to generate favorable mutations in the count variables. We apply several variations on this basic idea to an idealized hanging chain example to obtain >> 1000x speedups over conventional genetic algorithms in both single - and multi-objective cases. We develop a more complex example of a notional military portfolio that includes combinatorial design variables and dependency constraints between the design choices. In this case, our initial results are mixed, but many variations are still open to further research.

More Details

City of Hoboken Energy Surety Analysis: Preliminary Design Summary

Stamp, Jason E.; Baca, Michael J.; Eddy, John P.; Guttromson, Ross G.; Henry, Jordan M.; Munoz-Ramos, Karina M.; Schenkman, Benjamin L.; Smith, Mark A.

In 2012, Hurricane Sandy devastated much of the U.S. northeast coastal areas. Among those hardest hit was the small community of Hoboken, New Jersey, located on the banks of the Hudson River across from Manhattan. This report describes a city-wide electrical infrastructure design that uses microgrids and other infrastructure to ensure the city retains functionality should such an event occur in the future. The designs ensure that up to 55 critical buildings will retain power during blackout or flooded conditions and include analysis for microgrid architectures, performance parameters, system control, renewable energy integration, and financial opportunities (while grid connected). The results presented here are not binding and are subject to change based on input from the Hoboken stakeholders, the integrator selected to manage and implement the microgrid, or other subject matter experts during the detailed (final) phase of the design effort.

More Details

GaN-based wide-bandgap power switching devices: From atoms to the grid

ECS Transactions

Atcitty, Stanley A.; Kaplar, Robert K.; DasGupta, Sandeepan D.; Marinella, Matthew J.; Armstrong, Andrew A.; Biedermann, Laura B.; Smith, Mark A.

Emerging semiconductor switches based on the wide-bandgap semiconductor GaN have the potential to significantly improve the efficiency of portable power applications such as transportable energy storage. Such applications are likely to become more widespread as renewables such as wind and solar continue to come on-line. However, the long-term reliability of GaN-based power devices is relatively unexplored. In this paper, we describe joint work between Sandia National Laboratories and MIT on highvoltage AlGaN/GaN high electron mobility transistors. It is observed that the nature of current collapse is a strong function of bias conditions as well as device design, where factors such as Al composition in the barrier layer and surface passivation play a large role. Thermal and optical recovery experiments are performed to ascertain the nature of charge trapping in the device. Additionally, Kelvin-force microscopy measurements are used to evaluate the surface potential within the device. © The Electrochemical Society.

More Details

Evaluating communications system performance effects at a system of systems level

Proceedings - IEEE Military Communications Conference MILCOM

Miner, Nadine E.; Van Leeuwen, Brian P.; Welch, Kimberly M.; Estill, Milford E.; Smith, Mark A.; Le, Hai D.; Lawton, Craig R.

The complexity of net-centric system of systems (SoS) being fielded today has the military leadership increasingly dependent on modeling and simulation (M&S) tools for evaluating performance. Several types of M&S tools are required to model different aspects of military systems, yet these tools often have different computational fidelities in terms of time and scale. Current approaches using direct information transfer between M&S tools, such as High Level Architecture (HLA) and MATREX, do not provide the mechanisms for disparate tools to make direct use of each other's information [1], [2]. Thus, many military SoS analyses assume perfect communications, an unrealistic assumption that leaves a gap for conducting more comprehensive analyses for large-scale, net-centric SoS problems. This research addresses this gap by developing general purpose methodologies to bridge the gap between diverse M&S tools resulting in a capability that enables military decision makers to evaluate comms system performance effects at a SoS level [3]. This paper discusses the methodology, including parameter selection, data generation, surrogate modeling and SoS simulation results. © 2012 IEEE.

More Details

Impact of the Al mole fraction in the bulk- and surface-state induced instability of AlGaN/GaN HEMTs

Materials Research Society Symposium Proceedings

DasGupta, S.; Sun, M.; Armstrong, Andrew A.; Kaplar, Robert K.; Marinella, M.; Stanley, James B.; Smith, Mark A.; Atcitty, Stanley A.; Palacios, T.

Charge trapping and slow (10 s to > 1000 s) detrapping in AlGaN/GaN HEMTs designed for high breakdown voltage (> 1500 V) are studied to identify the impact of Al molefraction and passivation on trapping. Two different trapping components, TG1 (E a = 0.62 eV) and TG2 (with negligible temperature dependence) in AlGaN dominate under gale bias stress in the off-state. Al 0.15Ga 0.85N shows much more vulnerability to trapping under gate stress in the absence of passivation than does AlGaN with a higher Al mole fraction. Under large drain bias, trapping is dominated by a much deeper trap TD. Detrapping under illumination by monochromatic light shows TD to have E a ≈ 1.65 eV in Al 0.26Ga 0.74N and E a ≈ 1.85 eV in Al 0.15Ga 0.85N. This is consistent with a transition from a deep state (E c - 2.0 eV) in the AlGaN barrier to the 2DEG. © 2012 Materials Research Society.

More Details
Results 1–25 of 46
Results 1–25 of 46