Publications

Many teams struggle to adapt and right-size software engineering best practices for quality assurance to fit their context. Introducing software quality is not usually framed in a way that motivates teams to take action, thus resulting in it becoming a "check the box for compliance"activity instead of a cultural practice that values software quality and the effort to achieve it. When and how can we provide effective incentives for software teams to adopt and integrate meaningful and enduring software quality practices? We explored this question through a persona-based ideation exercise at the 2021 Collegeville Workshop on Scientific Software in which we created three unique personas that represent different scientific software developer perspectives.

Dynamical systems subject to intermittent contact are often modeled with piecewise-smooth contact forces. However, the discontinuous nature of the contact can cause inaccuracies in numerical results or failure in numerical solvers. Representing the piecewise contact force with a continuous and smooth function can mitigate these problems, but not all continuous representations may be appropriate for this use. In this work, five representations used by previous researchers (polynomial, rational polynomial, hyperbolic tangent, arctangent, and logarithm-arctangent functions) are studied to determine which ones most accurately capture nonlinear behaviors including super- and subharmonic resonances, multiple solutions, and chaos. The test case is a single-DOF forced Duffing oscillator with freeplay nonlinearity, solved using direct time integration. This work intends to expand on past studies by determining the limits of applicability for each representation and what numerical problems may occur.

Rock salt is being considered as a medium for energy storage and radioactive waste disposal. A Disturbed Rock Zone (DRZ) develops in the immediate vicinity of excavations in rock salt, with an increase in permeability, which alters the migration of gases and liquids around the excavation. When creep occurs adjacent to a stiff inclusion such as a concrete plug, it is expected that the stress state near the inclusion will become more hydrostatic and less deviatoric, promoting healing (permeability reduction) of the DRZ. In this scoping study, we measured the permeability of DRZ rock salt with time adjacent to inclusions (plugs) of varying stiffness to determine how the healing of rock salt, as reflected in the permeability changes, is a function of the stress and time. Samples were created with three different inclusion materials in a central hole along the axis of a salt core: (i) very soft silicone sealant, (ii) sorel cement, and (iii) carbon steel. The measured permeabilities are corrected for the gas slippage effect. We observed that the permeability change is a function of the inclusion material. The stiffer the inclusion, the more rapidly the permeability reduces with time.

Density fluctuations in compressible turbulent boundary layers cause aero-optical distortions that affect the performance of optical systems such as sensors and lasers. The development of models for predicting the aero-optical distortions relies on theory and reference data that can be obtained from experiments and time-resolved simulations. This paper reports on wall-modeled large-eddy simulations of turbulent boundary layers over a flat plate at Mach 3.5, 7.87, and 13.64. The conditions for the Mach 3.5 case match those for the DNS presented by Miller et al.1 The Mach 7.87 simulation match those inside the Hypersonic Wind Tunnel at Sandia National Laboratories. For the Mach 13.64, the conditions inside the Arnold Engineering Development Complex Hypervelocity Tunnel 9 are matched. Overall, adequate agreement of the velocity and temperature as well as Reynolds stress profiles with reference data from direct numerical simulations is obtained for the different Mach numbers. For all three cases, the normalized root-mean-square optical path difference was computed and compared with data obtained from the reference direct numerical simulations and experiments, as well as predictions obtained with a semi-analytical relationship by Notre Dame University. Above Mach five, the normalized path difference obtained from the simulations is above the model prediction. This provides motivation for future work aimed at evaluating the assumptions behind the Notre Dame model for hypersonic boundary layer flows.

Magnetic skyrmions are nanoscale whirls of magnetism that can be propagated with electrical currents. The repulsion between skyrmions inspires their use for reversible computing based on the elastic billiard ball collisions proposed for conservative logic in 1982. In this letter, we evaluate the logical and physical reversibility of this skyrmion logic paradigm, as well as the limitations that must be addressed before dissipation-free computation can be realized.

The emerging use of the physics-based athermal recombination-corrected displacement per atom (arc-dpa) model for the displacement damage efficiency has motivated a re-evaluation of the historical empirically-derived GaAs damage response function with the purpose of highlighting needs for future analytical and experimental work. The 1-MeV neutron damage equivalence methodology used in the ASTM E-722 standard for GaAs has been re-evaluated using updated nuclear data. This yielded a higher fidelity representation of the GaAs displacement kerma and, through the use of the refined PKA recoil energy-dependent damage efficiency model, an updated 1-MeV(GaAs) displacement damage function. This re-evaluation included use of the Norgett-Robinson-Torrens (NRT) model for an updated threshold treatment, rather than the sharp-threshold Kinchin-Pease model used in the current ASTM standard. The underlying nuclear data evaluations have been updated to use the ENDF/VIII.0 75As and TENDL-2019 71Ga/69Ga evaluations. The displacement kerma and 1-MeV-equivalent damage responses were calculated using a modified NJOY-2016 code which allowed for refinements in some of the damage models. This paper shows that an updated displacement damage function, based upon the latest nuclear data, is consistent with the experimental data used to develop the current ASTM E-722 GaAs standard. Using a double ratio approach to compare the available experimental data with the calculated response, the average legacy double ratio was found to be 0.97±0.05 and the average updated double ratio was found to be 0.94 ±0.05.

A self-synchronizing underwater acoustic network, designed for remote monitoring of mooring loads in Wave Energy Converters (WEC), has been developed and tested. This network uses Time Division Multiple Access and operates self-contained with the ability for users to remotely transmit commands to the network as needed. Each node is a self-contained unit, consisting of a protocol adaptor board, an underwater acoustic modem and a battery pack. A node can be connected to a load cell, to a topside user or to the WEC. Every node is swapable. The protocol adaptor board, named Protocol Adaptor for Digital LOad Cell (PADLOC) supports a variety of digital load cell message formats (CAN, MODBUS, custom ASCII) and underwater acoustic modem serial formats. PADLOC enables topside users to connect to separate load cells through a user-specific command.

Simple but mission-critical internet-based applications that require extremely high reliability, availability, and verifiability (e.g., auditability) could benefit from running on robust public programmable blockchain platforms such as Ethereum. Unfortunately, program code running on such blockchains is normally publicly viewable, rendering these platforms unsuitable for applications requiring strict privacy of application code, data, and results. In this work, we investigate using MPC techniques to protect the privacy of a blockchain computation. While our main goal is to hide both the data and the computed function itself, we also consider the standard MPC setting where the function is public. We describe GABLE (Garbled Autonomous Bots Leveraging Ethereum), a blockchain MPC architecture and system. The GABLE architecture specifies the roles and capabilities of the players. GABLE includes two approaches for implementing MPC over blockchain: Garbled Circuits (GC), evaluating universal circuits, and Garbled Finite State Automata (GFSA). We formally model and prove the security of GABLE implemented over garbling schemes, a popular abstraction of GC and GFSA from (Bellare et al., CCS 2012). We analyze in detail the performance (including Ethereum gas costs) of both approaches and discuss the trade-offs. We implement a simple prototype of GABLE and report on the implementation issues and experience.

For the model-based control of low-voltage microgrids, state and parameter information are required. Different optimal estimation techniques can be employed for this purpose. However, these estimation techniques require knowledge of noise covariances (process and measurement noise). Incorrect values of noise covariances can deteriorate the estimator performance, which in turn can reduce the overall controller performance. This paper presents a method to identify noise covariances for voltage dynamics estimation in a microgrid. The method is based on the autocovariance least squares technique. A simulation study of a simplified 100 kVA, 208 V microgrid system in MATLAB/Simulink validates the method. Results show that estimation accuracy is close to the actual value for Gaussian noise, and non-Gaussian noise has a slightly larger error.

Advances in wind-plant control have often focused on more effectively balancing power between neighboring turbines. Wake steering is one such method that provides control-based improvements in a quasi-static way, but this does little to fundamentally change the wake recovery process, and thus, it has limited potential. This study investigates use of another control paradigm known as dynamic wake control (DWC) to excite the mutual inductance instability between adjacent tip-vortex structures, thereby accelerating the breakdown of the structures. The current work carries this approach beyond the hypothetical by applying the excitation via turbine control vectors that already exist on all modern wind turbines: blade pitch and rotor speed control. The investigation leverages a free-vortex wake method (FVWM) that allows a thorough exploration of relevant frequencies and amplitudes of harmonic forcing for each control vector (as well as the phase difference between the vectors for a tandem configuration) while still capturing the essential tip-vortex dynamics. The FVWM output feeds into a Fourier stability analysis working to pinpoint candidate DWC strategies suggesting fastest wake recovery. Near-wake length reductions of >80% are demonstrated, although without considering inflow turbulence. Analysis is provided to interpret these predictions considering the presence of turbulence in a real atmospheric inflow.

A crucial component of field testing is the utilization of numerical models to better understand the system and the experimental data being collected. Meshing and modeling field tests is a complex and computationally demanding problem. Hexahedral elements cannot always reproduce experimental dimensions leading to grid orientation or geometric errors. Voronoi meshes can match complex geometries without sacrificing orthogonality. As a result, here we present a high-resolution 3D numerical study for the BATS heater test at the WIPP that compares both a standard non-deformed cartesian mesh along with a Voronoi mesh to match field data collected during a salt heater experiment.

Operon prediction in prokaryotes is critical not only for understanding the regulation of endogenous gene expression, but also for exogenous targeting of genes using newly developed tools such as CRISPR-based gene modulation. A number of methods have used transcriptomics data to predict operons, based on the premise that contiguous genes in an operon will be expressed at similar levels. While promising results have been observed using these methods, most of them do not address uncertainty caused by technical variability between experiments, which is especially relevant when the amount of data available is small. In addition, many existing methods do not provide the flexibility to determine the stringency with which genes should be evaluated for being in an operon pair. We present OperonSEQer, a set of machine learning algorithms that uses the statistic and p-value from a non-parametric analysis of variance test (Kruskal-Wallis) to determine the likelihood that two adjacent genes are expressed from the same RNA molecule. We implement a voting system to allow users to choose the stringency of operon calls depending on whether your priority is high recall or high specificity. In addition, we provide the code so that users can retrain the algorithm and re-establish hyperparameters based on any data they choose, allowing for this method to be expanded as additional data is generated. We show that our approach detects operon pairs that are missed by current methods by comparing our predictions to publicly available long-read sequencing data. OperonSEQer therefore improves on existing methods in terms of accuracy, flexibility, and adaptability.

This work presents an experimental investigation of the deformation and breakup of water drops behind conical shock waves. A conical shock is generated by firing a bullet at Mach 4.5 past a vertical column of drops with a mean initial diameter of 192 µm. The time-resolved drop position and maximum transverse dimension are characterized using backlit stereo videos taken at 500 kHz. A Reynolds-Averaged Navier Stokes (RANS) simulation of the bullet is used to estimate the gas density and velocity fields experienced by the drops. Classical correlations for breakup times derived from planar-shock/drop interactions are evaluated. Predicted drop breakup times are found to be in error by a factor of three or more, indicating that existing correlations are inadequate for predicting the response to the three-dimensional relaxation of the velocity and thermodynamic properties downstream of the conical shock. Next, the Taylor Analogy Breakup (TAB) model, which solves a transient equation for drop deformation, is evaluated. TAB predictions for drop diameter calculated using a dimensionless constant of C2 = 2, as compared to the accepted value of C2 = 2/3, are found to agree within the confidence bounds of the ensemble averaged experimental values for all drops studied. These results suggest the three-dimensional relaxation effects behind conical shock waves alter the drop response in comparison to a step change across a planar shock, and that future models describing the interaction between a drop and a non-planar shock wave should account for flow field variations.

The installation of digital sensors, such as advanced meter infrastructure (AMI) meters, has provided the means to implement a wide variety of techniques to increase visibility into the distribution system, including the ability to calibrate the utility models using data-driven algorithms. One challenge in maintaining accurate and up-to-date distribution system models is identifying changes and event occurrences that happen during the year, such as customers who have changed phases due to maintenance or other events. This work proposes a method for the detection of phase change events that utilizes techniques from an existing phase identification algorithm. This work utilizes an ensemble step to obtain predicted phases for windows of data, therefore allowing the predicted phase of customers to be observed over time. The proposed algorithm was tested on four utility datasets as well as a synthetic dataset. The synthetic tests showed the algorithm was capable of accurately detecting true phase change events while limiting the number of false-positive events flagged. In addition, the algorithm was able to identify possible phase change events on two real datasets.

Coupled Mode Theory (CMT) is a classic model that addresses many diverse problems in physics and electrical engineering. Although CMT is well-established in areas such as filter and directional coupler design, its significance in antenna engineering is less well-recognized. Recently, Characteristic Mode Analysis has shown how CMT quantitatively models a wide variety of broadband, multi-mode patch structures. In this paper, we review these results and discuss the similarities and differences between these radiators through the lens of CMT. With these principles in mind, multi-mode radiators may be designed in a straightforward manner and new ideas for broadband, multi-mode patches are stimulated.

Hyperspectral Computed Tomography (HCT) Data is often visualized using dimension reduction algorithms. However, these methods often fail to adequately differentiate between materials with similar spectral signatures. Previous work showed that a combination of image preprocessing, clustering, and dimension reduction techniques can be used to colorize simulated HCT data and enhance the contrast between similar materials. In this work, we evaluate the efficacy of these existing methods on experimental HCT data and propose new improvements to the robustness of these methods. We introduce an automated channel selection method and compare the Feldkamp, Davis, and Kress filtered back-projection (FBP) algorithm with the maximum-likelihood estimation-maximization (MLEM) algorithm in terms of HCT reconstruction image quality and its effect on different colorization methods. Additionally, we propose adaptations to the colorization process that eliminate the need for a priori knowledge of the number distinct materials for material classification. Our results show that these methods generalize to materials in real-world experimental HCT data for both colorization and classification tasks; both tasks have applications in industry, medicine, and security, wherever rapid visualization and identification is needed.

In transit visualization offers a desirable approach to performing in situ visualization by decoupling the simulation and visualization components. This decoupling requires that the data be transferred from the simulation to the visualization, which is typically done using some form of aggregation and redistribution. As the data distribution is adjusted to match the visualization’s parallelism during redistribution, the data transport layer must have knowledge of the input data structures to partition or merge them. In this chapter, we will discuss an alternative approach suitable for quickly integrating in transit visualization into simulations without incurring significant overhead or aggregation cost. Our approach adopts an abstract view of the input simulation data and works only on regions of space owned by the simulation ranks, which are sent to visualization clients on demand.

Communication-assisted adaptive protection can improve the speed and selectivity of the protection system. However, in the event, that communication is disrupted to the relays from the centralized adaptive protection system, predicting the local relay protection settings is a viable alternative. This work evaluates the potential for machine learning to overcome these challenges by using the Prophet algorithm programmed into each relay to individually predict the time-dial (TDS) and pickup current (IPICKUP) settings. A modified IEEE 123 feeder was used to generate the data needed to train and test the Prophet algorithm to individually predict the TDS and IPICKUP settings. The models were evaluated using the mean average percentage error (MAPE) and the root mean squared error (RMSE) as metrics. The results show that the algorithms could accurately predict IPICKUP setting with an average MAPE accuracy of 99.961%, and the TDS setting with a average MAPE accuracy of 94.32% which is sufficient for protection parameter prediction.

The goal of this paper is to present a set of measurements from a benchmark structure containing two bolted joints to support future efforts to predict the damping due to the joints and to model nonlinear coupling between the first two elastic modes. Bolted joints introduce nonlinearities in structures, typically causing a softening in the natural frequency and an increase in damping because of frictional slip between the contact interfaces within the joint. These nonlinearities pose significant challenges when characterizing the response of the structure under a large range of load amplitudes, especially when the modal responses become coupled, causing the effective damping and natural frequency to not only depend on the excitation amplitude of the targeted mode, but also the relative amplitudes of other modes. In this work, two nominally identical benchmark structures, known in some prior works as the S4 beam, are tested to characterize their nonlinear properties for the first two elastic modes. Detailed surface measurements are presented and validated through finite element analysis and reveal distinct contact interactions between the two sets of beams. The free-free test structures are excited with an impact hammer and the transient response is analyzed to extract the damping and frequency backbone curves. A range of impact amplitudes and drive points are used to isolate a single mode or to excite both modes simultaneously. Differences in the nonlinear response correlate with the relative strength of the modes that are excited, allowing one to characterize mode coupling. Each of the beams shows different nonlinear properties for each mode, which is attributed to the different contact pressure distributions between the parts, although the mode coupling relationship is found to be consistent between the two. The test data key finding are presented in this paper and the supporting data is available on a public repository for interested researchers.

In high temperature (HT) environments often encountered in geothermal wells, data rate transfers for downhole instrumentation are relatively limited due to transmission line bandwidth and insertion loss and the processing speed of HT microcontrollers. In previous research, Sandia National Laboratory Geothermal Department obtained 3.8 Mbps data rates over 1524 m (5000 ft) for single conductor wireline cable with less than a 1x10^-8 bit error rate utilizing low temperature NI^TM hardware (formerly National Instruments^TM). Our protocol technique was a combination of orthogonal frequency-division multiplexing and quadrature amplitude modulation across the bandwidth of the single conductor wireline. This showed it is possible to obtain high data rates in low bandwidth wirelines. This paper focuses on commercial HT microcontrollers (µC), rather than low temperature NI^TM modules, to enable high-speed communication in an HT environment. As part of this effort, four devices were evaluated, and an optimal device (SM320F28335-HT) was selected for its high clock rates, floating-point unit, and on-board analog-to-digital converter. A printed circuit board was assembled with the HT µC, an HT resistor digital-to-analog converter, and an HT line driver. The board was tested at the microcontroller's rated maximum temperature (210°C) for a week while transmitting through a 1524 m (5000 ft) wireline. A final test was conducted to the point of failure at elevated temperatures. This paper will discuss communication methods, achieved data rates, and hardware selection. This effort contributes to the enhancement of HT instrumentation by enabling greater sensor counts and improving data accuracy and transfer rates.

In recent years we have been exploring a novel asynchronous, ballistic physical model of reversible computing, variously termed ABRC (Asynchronous Ballistic Reversible Computing) or BARC (Ballistic Asynchronous Reversible Computing). In this model, localized information-bearing pulses propagate bidi-rectionally along nonbranching interconnects between I/O ports of stateful circuit elements, which carry out reversible transformations of the local digital state. The model appears suitable for implementation in superconducting circuits, using the naturally quantized configuration of magnetic flux in the circuit to encode digital information. One of the early research thrusts in this effort involves the enumeration and classification, at an abstract theoretical level, of the distinct possible reversible digital functional behaviors that primitive BARC circuit elements may exhibit, given the applicable conservation and symmetry constraints in superconducting implementations. In this paper, we describe the motivations for this work, outline our research methodology, and summarize some of the noteworthy preliminary results to date from our theoretical study of BARC elements for bipolarized pulses, and having up to three I/O ports and two internal digital states.

Area efficient self-correcting flip-flops for use with triple modular redundant (TMR) soft-error hardened logic are implemented in a 12-nm finFET process technology. The TMR flip-flop slave latches self-correct in the clock low phase using Muller C-elements in the latch feedback. These C-elements are driven by the two redundant stored values and not by the slave latch itself, saving area over a similar implementation using majority gate feedback. These flip-flops are implemented as large shift-register arrays on a test chip and have been experimentally tested for their soft-error mitigation in static and dynamic modes of operation using heavy ions and protons. We show how high clock skew can result in susceptibility to soft-errors in the dynamic mode, and explain the potential failure mechanism.

Interest in the application of DC Microgrids to distribution systems have been spurred by the continued rise of renewable energy resources and the dependence on DC loads. However, in comparison to AC systems, the lack of natural zero crossing in DC Microgrids makes the interruption of fault currents with fuses and circuit breakers more difficult. DC faults can cause severe damage to voltage-source converters within few milliseconds, hence, the need to quickly detect and isolate the fault. In this paper, the potential for five different Machine Learning (ML) classifiers to identify fault type and fault resistance in a DC Microgrid is explored. The ML algorithms are trained using simulated fault data recorded from a 750 VDC Microgrid modeled in PSCAD/EMTDC. The performance of the trained algorithms are tested using real fault data gathered from an operational DC Microgrid located on the Kirtland Air Force Base. Of the five ML algorithms, three could detect the fault and determine the fault type with at least 99% accuracy, and only one could estimate the fault resistance with at least 99% accuracy. By performing a self-learning monitoring and decision making analysis, protection relays equipped with ML algorithms can quickly detect and isolate faults to improve the protection operations on DC Microgrids.

Geographic analysis of photovoltaic (PV) performance factors across large regions can help relevant stakeholders make informed, and reduced risk decisions. High temporal and spatial resolution meteorological data from the National Solar Radiation Database are used to investigate performance and cost as an effect of varying system characteristics such as the module temperature coefficients, mounting configurations and coatings. The results demonstrated the strong climatic dependence that these characteristics have on annual energy yield whereas the revenues were dominated by the electricity price.

Frequent changes in penetration levels of distributed energy resources (DERs) and grid control objectives have caused the maintenance of accurate and reliable grid models for behind-the-meter (BTM) photovoltaic (PV) system impact studies to become an increasingly challenging task. At the same time, high adoption rates of advanced metering infrastructure (AMI) devices have improved load modeling techniques and have enabled the application of machine learning algorithms to a wide variety of model calibration tasks. Therefore, we propose that these algorithms can be applied to improve the quality of the input data and grid models used for PV impact studies. In this paper, these potential improvements were assessed for their ability to improve the accuracy of locational BTM PV hosting capacity analysis (HCA). Specifically, the voltage- and thermal-constrained hosting capacities of every customer location on a distribution feeder (1,379 in total) were calculated every 15 minutes for an entire year before and after each calibration algorithm or load modeling technique was applied. Overall, the HCA results were found to be highly sensitive to the various modeling deficiencies under investigation, illustrating the opportunity for more data-centric/model-free approaches to PV impact studies.

The detonation of explosives produces luminous fireballs often containing particulates such as carbon soot or remnants of partially reacted explosives. The spatial distribution of these particulates is of great interest for the derivation and validation of models. In this work, three ultra-high-speed imaging techniques: diffuse back-illumination extinction, schlieren, and emission imaging, are utilized to investigate the particulate quantity, spatial distribution, and structure in a small-scale fireball. The measurements show the evolution of the particulate cloud in the fireball, identifying possible emission sources and regions of high optical thickness. Extinction measurements performed at two wavelengths shows that extinction follows the inverse wavelength behavior expected of absorptive particles in the Rayleigh scattering regime. The estimated mass from these extinction measurements shows an average soot yield consistent with previous soot collection experiments. The imaging diagnostics discussed in the current work can provide detailed information on the spatial distribution and concentration of soot, crucial for validation opportunities in the future.

Abstract not provided.

A new set of critical experiments exploring the temperature-dependence of the reactivity in a critical assembly is described. In the experiments, the temperature of the critical assembly will be varied to determine the temperature that produces the highest reactivity in the assembly. This temperature is the inversion point of the isothermal reactivity coefficient of the assembly. An analysis of relevant configurations is presented. Existing measurements are described and an analysis of these experiments presented. The overall experimental approach is described as are the modifications to the critical assembly needed to perform the experiments.

This study presents a method that can be used to gain information relevant to determining the corrosion risk for spent nuclear fuel (SNF) canisters during extended dry storage. Currently, it is known that stainless steel canisters are susceptible to chloride-induced stress corrosion cracking (CISCC). However, the rate of CISCC degradation and the likelihood that it could lead to a through-wall crack is unknown. This study uses well-developed computational fluid dynamics and particle-tracking tools and applies them to SNF storage to determine the rate of deposition on canisters. The deposition rate is determined for a vertical canister system and a horizontal canister system, at various decay heat rates with a uniform particle size distribution, ranging from 0.25 to 25 µm, used as an input. In all cases, most of the dust entering the overpack passed through without depositing. Most of what was retained in the overpack was deposited on overpack surfaces (e.g., inlet and outlet vents); only a small fraction was deposited on the canister itself. These results are provided for generalized canister systems with a generalized input; as such, this technical note is intended to demonstrate the technique. This study is a part of an ongoing effort funded by the U.S. Department of Energy, Nuclear Energy Office of Spent Fuel Waste Science and Technology, which is tasked with doing research relevant to developing a sound technical basis for ensuring the safe extended storage and subsequent transport of SNF. This work is being presented to demonstrate a potentially useful technique for SNF canister vendors, utilities, regulators, and stakeholders to utilize and further develop for their own designs and site-specific studies.

Neural networks (NN) have become almost ubiquitous with image classification, but in their standard form produce point estimates, with no measure of confidence. Bayesian neural networks (BNN) provide uncertainty quantification (UQ) for NN predictions and estimates through the posterior distribution. As NN are applied in more high-consequence applications, UQ is becoming a requirement. Automating systems can save time and money, but only if the operator can trust what the system outputs. BNN provide a solution to this problem by not only giving accurate predictions and estimates, but also an interval that includes reasonable values within a desired probability. Despite their positive attributes, BNN are notoriously difficult and time consuming to train. Traditional Bayesian methods use Markov Chain Monte Carlo (MCMC), but this is often brushed aside as being too slow. The most common method is variational inference (VI) due to its fast computation, but there are multiple concerns with its efficacy. MCMC is the gold standard and given enough time, will produce the correct result. VI, alternatively, is an approximation that converges asymptotically. Unfortunately (or fortunately), high consequence problems often do not live in the land of asymtopia so solutions like MCMC are preferable to approximations. We apply and compare MCMC-and VI-trained BNN in the context of target detection in hyperspectral imagery (HSI), where materials of interest can be identified by their unique spectral signature. This is a challenging field, due to the numerous permuting effects practical collection of HSI has on measured spectra. Both models are trained using out-of-the-box tools on a high fidelity HSI target detection scene. Both MCMC-and VI-trained BNN perform well overall at target detection on a simulated HSI scene. Splitting the test set predictions into two classes, high confidence and low confidence predictions, presents a path to automation. For the MCMC-trained BNN, the high confidence predictions have a 0.95 probability of detection with a false alarm rate of 0.05 when considering pixels with target abundance of 0.2. VI-trained BNN have a 0.25 probability of detection for the same, but its performance on high confidence sets matched MCMC for abundances >0.4. However, the VI-trained BNN on this scene required significant expert tuning to get these results while MCMC worked immediately. On neither scene was MCMC prohibitively time consuming, as is often assumed, but the networks we used were relatively small. This paper provides an example of how to utilize the benefits of UQ, but also to increase awareness that different training methods can give different results for the same model. If sufficient computational resources are available, the best approach rather than the fastest or most efficient should be used, especially for high consequence problems.

Applications such as counterfeit identification, quality control, and non-destructive material identification benefit from improved spatial and compositional analysis. X-ray Computed Tomography is used in these applications but is limited by the X-ray focal spot size and the lack of energy-resolved data. Recently developed hyperspectral X-ray detectors estimate photon energy, which enables composition analysis but lacks spatial resolution. Moving beyond bulk homogeneous transmission anodes toward multi-metal patterned anodes enables improvements in spatial resolution and signal-to-noise ratios in these hyperspectral X-ray imaging systems. We aim to design and fabricate transmission anodes that facilitate confirmation of previous simulation results. These anodes are fabricated on diamond substrates with conventional photolithography and metal deposition processes. The final transmission anode design consists of a cluster of three disjoint metal bumps selected from molybdenum, silver, samarium, tungsten, and gold. These metals are chosen for their k-lines, which are positioned within distinct energy intervals of interest and are readily available in standard clean rooms. The diamond substrate is chosen for its high thermal conductivity and high transmittance of X-rays. The feature size of the metal bumps is chosen such that the cluster is smaller than the 100 m diameter of the impinging electron beam in the X-ray tube. This effectively shrinks the X-ray focal spot in the selected energy bands. Once fabricated, our transmission anode is packaged in a stainless-steel holder that can be retrofitted into our existing X-ray tube. Innovations in anode design enable an inexpensive and simple method to improve existing X-ray imaging systems.

Multi-model Monte Carlo methods have been illustrated to be an efficient and accurate alternative to standard Monte Carlo (MC) in the model-based propagation of uncertainty in entry, descent, and landing (EDL) applications. These multi-model MC methods fuse predictions from low-fidelity models with the high-fidelity EDL model of interest to produce unbiased statistics with a fraction of the computational cost. The accuracy and efficiency of the multi-model MC methods are dependent upon the magnitude of correlations of the low-fidelity models with the high-fidelity model, but also upon the correlation amongst the low-fidelity models, and their relative computational cost. Because of this layer of complexity, the question of how to optimally select the set of low-fidelity models has remained open. In this work, methods for optimal model construction and tuning are investigated as a means to increase the speed and precision of trajectory simulation for EDL. Specifically, the focus is on the inclusion of low-fidelity model tuning within the sample allocation optimization that accompanies multi-model MC methods. Results indicate that low-fidelity model tuning can significantly improve efficiency and precision of trajectory simulations and provide an increased edge to multi-model MC methods when compared to standard MC.

Abstract not provided.

The s-step Conjugate Gradient (CG) algorithm has the potential to reduce the communication cost of standard CG by a factor of s. However, though mathematically equivalent, s-step CG may be numerically less stable compared to standard CG in finite precision, exhibiting slower convergence and decreased attainable accuracy. This limits the use of s-step CG in practice. To improve the numerical behavior of s-step CG and overcome this potential limitation, we incorporate two techniques. First, we improve convergence behavior through the use of higher precision at critical parts of the s-step iteration and second, we integrate a residual replacement strategy into the resulting mixed precision s-step CG to improve attainable accuracy. Our experimental results on the Summit Supercomputer demonstrate that when the higher precision is implemented in hardware, these techniques have virtually no overhead on the iteration time while improving both the convergence rate and the attainable accuracy of s-step CG. Even when the higher precision is implemented in software, these techniques may still reduce the time-to-solution (speedups of up to 1.8times in our experiments), especially when s-step CG suffers from numerical instability with a small step size and the latency cost becomes a significant part of its iteration time.

Abstract not provided.

The penetration of renewable energy resources (RER) and energy storage systems (ESS) into the power grid has been accelerated in recent times due to the aggressive emission and RER penetration targets. The Integrated resource planning (IRP) framework can help in ensuring long-term resource adequacy while satisfying RER integration and emission reduction targets in a cost-effective and reliable manner. In this paper, we present pIRP (probabilistic Integrated Resource Planning), an open-source Python-based software tool designed for optimal portfolio planning for an RER and ESS rich future grid and for addressing the capacity expansion problem. The tool, which is planned to be released publicly, with its ESS and RER modeling capabilities along with enhanced uncertainty handling make it one of the more advanced non-commercial IRP tools available currently. Additionally, the tool is equipped with an intuitive graphical user interface and expansive plotting capabilities. Impacts of uncertainties in the system are captured using Monte Carlo simulations and lets the users analyze hundreds of scenarios with detailed scenario reports. A linear programming based architecture is adopted which ensures sufficiently fast solution time while considering hundreds of scenarios and characterizing profile risks with varying levels of RER and ESS penetration levels. Results for a test case using data from parts of the Eastern Interconnection are provided in this paper to demonstrate the capabilities offered by the tool.

Creation of streaming video stimuli that allow for strict experimental control while providing ease of scene manipulation is difficult to achieve but desired by researchers seeking to approach ecological validity in contexts that involve processing streaming visual information. To that end, we propose leveraging video game modding tools as a method of creating research quality stimuli. As a pilot effort, we used a video game sandbox tool (Garry’s Mod) to create three steaming video scenarios designed to mimic video feeds that physical security personnel might observe. All scenarios required participants to identify the presences of a threat appearing during the video feed. Each scenario differed in level of complexity, in that one scenario required only location monitoring, one required location and action monitoring, and one required location, action, and conjunction monitoring in that when an action was performed it was only considered a threat when performed by a certain character model. While there was no behavioral effect of scenario in terms of accuracy or response times, in all scenarios we found evidence of a P300 when comparing response to threatening stimuli to that of standard stimuli. Results therefore indicate that sufficient levels of experimental control may be achieved to allow for the precise timing required for ERP analysis. Thus, we demonstrate the feasibility of using existing modding tools to create video scenarios amenable to neuroimaging analysis.

Modern distribution systems can accommodate different topologies through controllable tie lines for increasing the reliability of the system. Estimating the prevailing circuit topology or configuration is of particular importance at the substation for different applications to properly operate and control the distribution system. One of the applications of circuit configuration estimation is adaptive protection. An adaptive protection system relies on the communication system infrastructure to identify the latest status of power. However, when the communication links to some of the equipment are outaged, the adaptive protection system may lose its awareness over the status of the system. Therefore, it is necessary to estimate the circuit status using the available healthy communicated data. This paper proposes the use of machine learning algorithms at the substation to estimate circuit configuration when the communication to the tie breakers is compromised. Doing so, the adaptive protection system can identify the correct protection settings corresponding to the estimated circuit topology. The effectiveness of the proposed approach is verified on IEEE 123 bus test system.

Numerical simulations of Greenland and Antarctic ice sheets involve the solution of large-scale highly nonlinear systems of equations on complex shallow geometries. This work is concerned with the construction of Schwarz preconditioners for the solution of the associated tangent problems, which are challenging for solvers mainly because of the strong anisotropy of the meshes and wildly changing boundary conditions that can lead to poorly constrained problems on large portions of the domain. Here, two-level generalized Dryja-Smith-Widlund (GDSW)-type Schwarz preconditioners are applied to different land ice problems, i.e., a velocity problem, a temperature problem, as well as the coupling of the former two problems. We employ the message passing interface (MPI)- parallel implementation of multilevel Schwarz preconditioners provided by the package FROSch (fast and robust Schwarz) from the Trilinos library. The strength of the proposed preconditioner is that it yields out-of-the-box scalable and robust preconditioners for the single physics problems. To the best of our knowledge, this is the first time two-level Schwarz preconditioners have been applied to the ice sheet problem and a scalable preconditioner has been used for the coupled problem. The preconditioner for the coupled problem differs from previous monolithic GDSW preconditioners in the sense that decoupled extension operators are used to compute the values in the interior of the subdomains. Several approaches for improving the performance, such as reuse strategies and shared memory OpenMP parallelization, are explored as well. In our numerical study we target both uniform meshes of varying resolution for the Antarctic ice sheet as well as nonuniform meshes for the Greenland ice sheet. We present several weak and strong scaling studies confirming the robustness of the approach and the parallel scalability of the FROSch implementation. Among the highlights of the numerical results are a weak scaling study for up to 32 K processor cores (8 K MPI ranks and 4 OpenMP threads) and 566 M degrees of freedom for the velocity problem as well as a strong scaling study for up to 4 K processor cores (and MPI ranks) and 68 M degrees of freedom for the coupled problem.

We evaluate the use of reference modules for monitoring effective irradiance in PV power plants, as compared with traditional plane-of-array (POA) irradiance sensors, for PV monitoring and capacity tests. Common POA sensors such as pyranometers and reference cells are unable to capture module-level irradiance nonuniformity and require several correction factors to accurately represent the conditions for fielded modules. These problems are compounded for bifacial systems, where the power loss due to rear side shading and rear-side plane-of-array (RPOA) irradiance gradients are greater and more difficult to quantify. The resulting inaccuracy can have costly real-world consequences, particularly when the data are used to perform power ratings and capacity tests. Here we analyze data from a bifacial single-axis tracking PV power plant, (175.6 MWdc) using 5 meteorological (MET) stations, located on corresponding inverter blocks with capacities over 4 MWdc. Each MET station consists of bifacial reference modules as well pyranometers mounted in traditional POA and RPOA installations across the PV power plant. Short circuit current measurements of the reference modules are converted to effective irradiance with temperature correction and scaling based on flash test or nameplate short circuit values. Our work shows that bifacial effective irradiance measured by pyranometers averages 3.6% higher than the effective irradiance measured by bifacial reference modules, even when accounting for spectral, angle of incidence, and irradiance nonuniformity. We also performed capacity tests using effective irradiance measured by pyranometers and reference modules for each of the 5 bifacial single-axis tracking inverter blocks mentioned above. These capacity tests evaluated bifacial plant performance at ∼3.9% lower when using bifacial effective irradiance from pyranometers as compared to the same calculation performed with reference modules.

We computationally explore the optical and elastic modes necessary for acoustoelectrically enhanced Brillouin interactions. The large simulated piezoelectric (k2 « 6%) and optome-chanica (lgol ≈ 8000 (rad/s)√m) coupling theoretically predicts a performance enhancement several order of magniude in brrloum-based photoine tecnnologres.

It is impossible in practice to comprehensively test even small software programs due to the vastness of the reachable state space; however, modern cyber-physical systems such as aircraft require a high degree of confidence in software safety and reliability. Here we explore methods of generating test sets to effectively and efficiently explore the state space for a module based on the Traffic Collision Avoidance System (TCAS) used on commercial aircraft. A formal model of TCAS in the model-checking language NuSMV provides an output oracle. We compare test sets generated using various methods, including covering arrays, random, and a low-complexity input paradigm applied to 28 versions of the TCAS C program containing seeded errors. Faults are triggered by tests for all 28 programs using a combination of covering arrays and random input generation. Complexity-based inputs perform more efficiently than covering arrays, and can be paired with random input generation to create efficient and effective test sets. A random forest classifier identifies variable values that can be targeted to generate tests even more efficiently in future work, by combining a machine-learned fuzzing algorithm with more complex model oracles developed in model-based systems engineering (MBSE) software.

We evaluate the use of reference modules for monitoring effective irradiance in PV power plants, as compared with traditional plane-of-array (POA) irradiance sensors, for PV monitoring and capacity tests. Common POA sensors such as pyranometers and reference cells are unable to capture module-level irradiance nonuniformity and require several correction factors to accurately represent the conditions for fielded modules. These problems are compounded for bifacial systems, where the power loss due to rear side shading and rear-side plane-of-array (RPOA) irradiance gradients are greater and more difficult to quantify. The resulting inaccuracy can have costly real-world consequences, particularly when the data are used to perform power ratings and capacity tests. Here we analyze data from a bifacial single-axis tracking PV power plant, (175.6 MWdc) using 5 meteorological (MET) stations, located on corresponding inverter blocks with capacities over 4 MWdc. Each MET station consists of bifacial reference modules as well pyranometers mounted in traditional POA and RPOA installations across the PV power plant. Short circuit current measurements of the reference modules are converted to effective irradiance with temperature correction and scaling based on flash test or nameplate short circuit values. Our work shows that bifacial effective irradiance measured by pyranometers averages 3.6% higher than the effective irradiance measured by bifacial reference modules, even when accounting for spectral, angle of incidence, and irradiance nonuniformity. We also performed capacity tests using effective irradiance measured by pyranometers and reference modules for each of the 5 bifacial single-axis tracking inverter blocks mentioned above. These capacity tests evaluated bifacial plant performance at ∼3.9% lower when using bifacial effective irradiance from pyranometers as compared to the same calculation performed with reference modules.

The paper proposes an implementation of Graph Neural Networks (GNNs) for distribution power system Traveling Wave (TW) - based protection schemes. Simulated faults on the IEEE 34 system are processed by using the Karrenbauer Transform and the Stationary Wavelet Transform (SWT), and the energy of the resulting signals is calculated using the Parseval's Energy Theorem. This data is used to train Graph Convolutional Networks (GCNs) to perform fault zone location. Several levels of measurement noise are considered for comparison. The results show outstanding performance, more than 90% for the most developed models, and outline a fast, reliable, asynchronous and distributed protection scheme for distribution level networks.

As the legacy distance protection schemes are starting to transition from impedance-based to traveling wave (TW) time-based, it is important to perform diligent simulations prior to commissioning the TW relay. Since Control-Hardware-In-the-Loop (CHIL) simulations have recently become a common practice for power system research, this work aims to illustrate some limitations in the integration of commercially available TW relays in CHIL for transmission-level simulations. The interconnection of Frequency-Dependent (FD) with PI-modeled transmission lines, which is a common practice in CHIL, may lead to sharp reflections that ease the relaying task. However, modeling contiguous lines as FD, or the presence of certain shunt loads, may cover certain TW reflections. As a consequence, the fault location algorithm in the relay may lead to a wrong calculation. In this paper, a qualitative comparison of the performance of commercially available TW relay is carried out to show how the system modeling in CHIL may affect the fault location accuracy.

The National Academy of Sciences, Engineering, and Medicine (NASEM) defines reproducibility as 'obtaining consistent computational results using the same input data, computational steps, methods, code, and conditions of analysis,' and replicability as 'obtaining consistent results across studies aimed at answering the same scientific question, each of which has obtained its own data' [1]. Due to an increasing number of applications of artificial intelligence and machine learning (AI/ML) to fields such as healthcare and digital medicine, there is a growing need for verifiable AI/ML results, and therefore reproducible research and replicable experiments. This paper establishes examples of irreproducible AI/ML applications to medical sciences and quantifies the variance of common AI/ML models (Artificial Neural Network, Naive Bayes classifier, and Random Forest classifiers) for tasks on medical data sets.

Numerous projects are looking into distributing blends of natural gas and different amounts of gaseous hydrogen through the existing natural gas distribution system, which is widely composed of medium density polyethylene (MDPE) line pipes. The mechanical behavior of MDPE with hydrogen is not well understood; therefore, the effect of gaseous H2 on the mechanical properties of MDPE needs to be examined. In the current study, we investigate the effects of gaseous H2 on fatigue life and fracture resistance of MDPE in the presence of 3.4 MPa gaseous H2. Fatigue life tests were also conducted at a pressure of 21 MPa to investigate the effect of gas pressure on the fatigue behavior of MDPE. Results showed that the presence of gaseous H2 did not degrade the fatigue life nor the fracture resistance of MDPE. Additionally, based on the value of fracture resistance calculated, a failure assessment diagram was constructed to determine the applicability of using MDPE pipeline for distribution of gaseous H2. Even in the presence of a large internal crack, the failure assessment evaluation indicated that the MDPE pipes lie within the safe region under typical service conditions of natural gas distribution pipeline system.

Large scale non-intrusive inspection (NII) of commercial vehicles is being adopted in the U.S. at a pace and scale that will result in a commensurate growth in adjudication burdens at land ports of entry. The use of computer vision and machine learning models to augment human operator capabilities is critical in this sector to ensure the flow of commerce and to maintain efficient and reliable security operations. The development of models for this scale and speed requires novel approaches to object detection and novel adjudication pipelines. Here we propose a notional combination of existing object detection tools using a novel ensembling framework to demonstrate the potential for hierarchical and recursive operations. Further, we explore the combination of object detection with image similarity as an adjacent capability to provide post-hoc oversight to the detection framework. The experiments described herein, while notional and intended for illustrative purposes, demonstrate that the judicious combination of diverse algorithms can result in a resilient workflow for the NII environment.

Modern distribution systems can accommodate different topologies through controllable tie lines for increasing the reliability of the system. Estimating the prevailing circuit topology or configuration is of particular importance at the substation for different applications to properly operate and control the distribution system. One of the applications of circuit configuration estimation is adaptive protection. An adaptive protection system relies on the communication system infrastructure to identify the latest status of power. However, when the communication links to some of the equipment are outaged, the adaptive protection system may lose its awareness over the status of the system. Therefore, it is necessary to estimate the circuit status using the available healthy communicated data. This paper proposes the use of machine learning algorithms at the substation to estimate circuit configuration when the communication to the tie breakers is compromised. Doing so, the adaptive protection system can identify the correct protection settings corresponding to the estimated circuit topology. The effectiveness of the proposed approach is verified on IEEE 123 bus test system.

A primary objective of repository modeling is identification and assessment of features and processes providing safety performance. Sensitivity analyses typically provide information on how input parameters affect performance, not features and processes. To quantify the effects of features and processes, tracers can be introduced virtually in model simulations and tracked in informative ways. This paper describes five ways virtual tracers can be used to directly measure the relative importance of several features, processes, and combinations of features and processes in repository performance assessment modeling.