In computer science, Document Summarization is the task of condensing some quantity of text and related content through automated means. In this document, we review recent literature in text summarization. “Hybrid” extractive-abstractive approaches continue to be explored. Some of the latest efforts have also sought to enable users to adjust summaries with queries or other structure and begun to test reinforcement-learning style agentic LLM-based solutions.
This paper describes Secure MQTT, a scheme proposed by Sandia National Laboratories that employs Identity-Based Encryption (IBE) for securing MQTT communications. Secure MQTT assumes and is conformant with an MQTT version 5 environment.
The Reynolds-averaged Navier–Stokes (RANS) equations remain a workhorse technology for simulating compressible fluid flows of practical interest. Due to model-form errors, however, RANS models can yield erroneous predictions that preclude their use on mission-critical problems. This report summarizes work performed from FY22-FY24 focused on improving RANS models for hypersonic flows using data-driven modeling and scientific machine learning. In this work we: 1. Investigate the current capabilities of RANS models in Sandia’s parallel aerodynamics and re-entry code (SPARC) for hypersonic flows with a focus on shock boundary layer interactions (SBLIs), 2. Assess several established corrections that exist in the literature aimed at improving predictions for SBLIs, 3. Develop improved models for the Reynolds stress tensor using tensor-basis neural networks, 4. Develop a neural-network-based variable turbulent Prandtl number model to reduce errors in wall heating in SBLIs. 5. Begin future investigations including employing the LIFE framework to improve wall heating predictions in SBLIs as well as the ensemble Kalman filter. We find that current RANS models in SPARC are deficient for complex SBLI flows. In particular, no current model jointly predicts wall heat flux, wall shear stress, and wall pressure with reasonable accuracy. Existing corrections help, but do not alleviate this issue altogether. The development of improved models for the Reynolds stress tensor via tensor-basis neural networks results in more predictive RANS models across a suite of low-speed and high-speed cases. For hypersonic boundary layers, the inclusion of the wall-normal Reynolds stress via TBNNs has an appreciable impact on the wall-normal momentum balance and wall quantities. However, we find that improvements to the Reynolds stress tensor do not address the over-prediction in wall heat flux in SBLIs. We find that a neural-network-based variable turbulent Prandtl number model systematically and substantially improves wall heating predictions for a range of SBLI cases.
This project develops a Bayesian optimization approach to extracting insights from Z Machine experimental data to determine if and how these insights can be used to extrapolate to a larger facility. The primary goal is to address the scientific challenge of informing how confidently experimental conditions can be predicted on a next generation facility, the design of which requires the reliable extrapolation of current high energy density technologies to regimes yet unobserved, except by costly high-fidelity computational models. Maximizing the use of presently available data and understanding how it informs future endeavors is critically important to enable transformative pulsed power and the science of extreme conditions. We explore a Bayesian optimization approach to experimental design which combines information theory, experimental data, and computational modeling to explore how information gain can be maximized.
Low temperature plasmas (LTPs) are an enabling technology behind reducing device dimensions and the continuation of Moore’s Law. It is estimated that 40-45% of all process steps necessary to manufacture semiconductor devices involve LTPs [4]. However, challenges in plasma process design and continuous incorporation of novel materials for new device architectures are pushing the limits of what is possible with current plasma technology. For example, creating higher aspect ratio structures and etching features at the atomic scale both require finer control of the ion energy/velocity at wafer surfaces. To support these types of future innovations in the plasma processing systems that Sandia and the DOE rely upon, we have developed novel diagnostics, simulations, and machine learning capabilities to discover, characterize, and predict plasma phenomena affecting the ion energy/velocity distribution function (IEDF). These efforts also supported research program devel opment and external collaboration with industry and academia through Sandia’s Plasma Research Facility (PRF). This report will focus on the following topics and accomplishments of this three year LDRD project, briefly summarized.
Total Variation optimization penalizes the gradient of a control variable or state. While this work focuses on image processing in particular, it has also found applications in inverse problems and topology optimization. In image processing, the goal is to maintain faithfulness to the original image while denoising and/or deblurring. Additionally, bilevel optimization over the spatially varying regularization weights can illuminate interfaces such as damage regions and other anomalies. We will address two fundamental challenges with TV-optimization: (i) the typical slow convergence of existing TV-optimization methods, and (ii) the selection of spatially varying TV parameters to promote interface detection. Additionally, we will apply such techniques to image data collected in additive manufacturing. In said context, stochasticity in build events induces flaws in the manufactured piece, compromising the integrity of said part. There is a critical need for in-situ monitoring to spot anomalies once they form, and in this setting we apply our total variation and hyperparameter solvers. We will develop a customized algorithm based on for extreme-scale TV-optimization that achieves super-linear or quadratic-convergence, a critical property for real-time, image-by-image analysis. A worst-case outcome is a preprocessing step that enhances image quality in-situ, specifically for out-of-focus and noisy images.
While quantum computing offers the promise of exponential advantages, limited quantum speedups are known, especially for practical applications. To open new avenues for quantum advantages, we propose Unconventional Quantum Advantages for Computation (U-QuACs), with respect to unconventional resources such as space (number of bits or quantum bits of memory required to solve a problem), accuracy of solution, communication, or energy consumption. We focus on space-efficient quantum algorithms, where we seek to design algorithms that solve a problem using much less space than the total size of the input. A natural setting in which space is critical is the streaming model of computation, where the input data arrives sequentially in pieces that must each be processed individually. Streaming is motivated by a variety of problems including analysis of internet traffic or social networks. We design the first exponential quantum space advantage for a natural streaming problem, which also constitutes the first quantum advantage for approximating a discrete optimization problem, albeit with respect to space.
Numerical linear algebra (NLA) underpins huge swaths of computational science and engineering. For scientists and engineers to make the most of the DOE’s computing resources, it is essential that they have access to high-performance implementations of algorithms with best-in-class scalability and reliability. Despite this, prevailing NLA libraries have little to no support for breakthrough algorithms from the field of randomized numerical linear algebra (RandNLA) that have been developed over the past twenty years. The goal of this LDRD was to break a log-jam that had prevented broad adoption of RandNLA. Our work had two thrusts. The first was to develop RandBLAS: a trustworthy and high-performance C++ library for randomized dimension reduction (an operation widely known as sketching). The second was the development of a novel randomized algorithm for computing a challenging type of matrix decomposition known as Householder QR with column pivoting (Householder QRCP). In this one-year late-start LDRD we successfully delivered RandBLAS 1.0 and new CPU and GPU codes for Householder QRCP. RandBLAS has extensive documentation at https://randblas.readthedocs.io/en/stable/. Papers on RandBLAS and and our high-performance QRCP codes are forthcoming.
Nitrogen-containing organic molecules play essential roles in nearly every aspect of chemistry. The importance of these species within gas-phase chemistry has increased in recent years, due to their emissions from wildfires, crude biofuels, ammonia combustion, and CO2 capture facilities. However, there is a lack of detailed relevant mechanistic and kinetic studies of N-compounds, resulting in poor representation of these pathways within chemical models. In this report, we detail our exploration of the gas-phase oxidation mechanisms of pyrrole, imidazole, pyrrolidine, methylamine, and dimethylamine, done by employing multiplexed VUV photoionization mass spectrometry coupled with KinBot, a computational tool that automatically explores multi-well potential energy surfaces. Overall, we vastly expanded the known gas-phase oxidation mechanisms and chemical kinetics of these species. This work will improve the accuracy and completeness of atmospheric and combustion chemistry models, ultimately leading to better-informed decision-makers in the energy and environmental sectors.
Two complementary approximations for describing aspects of continuum electromagnetics in moving media are discussed: electroquasistatic and magnetoquasistatic. Each has been implemented in the finite element shock code ALEGRA for modeling dynamic electromechanical phenomena on typical engineering time scales, with fully integrated circuit coupling (Niederhaus et al. 2023). The approximations can be obtained by consistent asymptotic balancing of Maxwell's equations relative to timescales associated with magnetic diffusion, charge relaxation, and electromagnetic wave propagation. In ALEGRA, the electroquasistatic approximation is used for ferroelectric (FE) modeling, while the magnetoquasistatic approximation is used for magnetohydrodynamic (MHD) modeling. In this paper we introduce for the first time a detailed derivation of a useful quasi-steady “low-Rm” variant of the MHD approximation applicable for cases, such as with detonators, where the thermodynamic pressure arising from Joule heating dominates over magnetic forces. An additional purpose of this paper is to present a coupling mode using Multiple Program-Multiple Data (MPMD) message passing communication that allows the user to run 3D FE problems together with 2D and/or 3D MHD problems with the respective simulation domains coupled through a common circuit equation. The MPMD coupling capability is used here to model the dynamic coupling of a notional ferroelectric generator with an RP-87 exploding bridgewire detonator. The simulated bridgewire heats up and bursts under current generated by simulated depoling of the ferroelectric generator, as a demonstration of the MPMD capability.
Comprehensive and consistent analysis, characterization, and classification of the wave climate at open-ocean wave energy converter (WEC) test sites guided by international standards enables commensurable evaluation and comparison of met-ocean characteristics, including wave energy resources and wave load conditions. Herein, we present results from a comprehensive feasibility-level met-ocean characterization for two Atlantic Marine Energy Center (AMEC) WEC test sites in the Gulf of Maine.
This project focused on developing topology optimization software to design advanced metal thermal insulators. Initially, solid designs were created that matched the thermal performance of current baseline designs but were significantly heavier. To address this, cellular materials were incorporated, specifically the octet structure which is known for its high strength-to-weight ratio and thermal properties. By leveraging these cellular designs at various densities, superior thermal and mechanical performance was achieved without added weight. This novel approach enhances thermal management and structural integrity under extreme conditions, offering promising advancements for thermal protection systems.
This project’s goal was to explore new methods and tools to evaluate the focused ion beam (FIB) effect on active electrical devices, which is becoming increasingly challenged by the continual decrease in transistor geometry. Novel hole transfer methods leveraging FIB patterning were demonstrated utilizing selective area atomic layer deposition (ALD) and metal assisted chemical etching. A FIB damage electrical tester device was fabricated, and the effects of FIB beams were characterized by examining change in performance of damaged transistors. Detailed characterization of end-of-range damage for common FIB ions were correlated to modeling methods. Finally, undamaged and damaged devices were simulated by Charon to begin understanding the FIB effects on active devices. This test platform along with modeling methods give a powerful way to assess FIB damage in materials and devices, and with more development can help establish methods to predict FIB damage effects on electrical devices.
Piezoelectric materials are used as a power source in stockpile components for safety and reliability assurances. The objective of this project is to gain insights into the fundamental pressure-induced behavior and electromechanical response of lead zirconate titanate (PZT). Specifically, to establish the basis for an accurate, physics-based material model for robust model-based design to rapidly optimize PZT-based materials and components for performance studies. Established ab-initio methods are used to interrogate and understand the dynamic behavior of PZT as a function of composition (50/50, 65/35, 80/20, 95/5) and dopants (La, Nb) to overcome the costly and time-consuming experimental methodologies. New cold curves for pure and doped single-crystal PZT are obtained as the reference equation-of-state (EOS). A negligible change in the pressure responses was observed for the systems and strains studied. Dielectric and piezoelectric responses of pure and doped single-crystal PZT were also calculated as a function of pressure. For undoped PZT, there is a clear and orderly pressure and composition dependence. For doped PZT, there is a significant increase in the responses, but the behavior is very disordered and inconclusive.
FLEXO (Flux-Limited Extended-MHD Ohm's Law) is a production-line multiphysics code developed at Sandia to enable more predictive modeling of target physics on pulsed-power devices. FLEXO uses an extended magnetohydrodynamics (XMHD) model which includes a generalized Ohm's law (GOL), an electron inertia term, and Hall physics. This report describes the code's numerical methods, its computational performance, and test problems of interest.
Laser-based nonlinear optical spectroscopy approaches have enabled the direct sensing of important chemistry in nearly every fundamental or applied field of science. Yet in many applications, increased detectivity is needed to unravel fundamental mechanisms. One possibility is the use of quantum entanglement to increase detection cross-sections, but it is unproven that enhancement from quantum light extends to practical intensities for chemical sensing. In this report, we investigated the creation and use of entangled photons in nonlinear optical mixing for second harmonic generation and infrared imaging. We observe that the linear scaling of nonlinear mixing from entangled photon sources extends to the mW laser power regime, and enhances direct infrared imaging on Si-based charge coupled device cameras. These results motivate future experimentation on practical uses of entangled photons for nonlinear optical sensing applications.
U.S. nuclear power facilities face increasing challenges in meeting dynamic security requirements caused by evolving and expanding threats while keeping costs reasonable to make nuclear energy competitive. The past approach has often included implementing security features after a facility has been designed and without attention to optimization, which can lead to cost overruns. Incorporating security into the design process can provide robust, cost-effective, and sufficient physical protection systems. The purpose of this report is to capture lessons learned by the Advanced Reactor Safeguards and Security (ARSS) program that may be beneficial for other advanced and small modular reactor (SMR) vendors to use when developing security systems and postures. This report will capture relevant information that can be used in the security-by-design (SeBD) process for SMR and microreactor vendors.
Modern computing systems are capable of exascale calculations, which are revolutionizing the development and application of high-fidelity numerical models in computational science and engineering. While these systems continue to grow in processing power, the available system memory has not increased commensurately, and electrical power consumption continues to grow. A predominant approach to limit the memory usage in large-scale applications is to exploit the abundant processing power and continually recompute many low-level simulation quantities, rather than storing them. However, this approach can adversely impact the throughput of the simulation and diminish the benefits of modern computing architectures. We present three novel contributions to reduce the memory burden while maintaining, and sometimes improving, performance in simulations based on finite element discretizations. The first contribution develops dictionary-based data compression schemes that detect and exploit the structure of the discretization, due to redundancies across the finite element mesh. While these schemes are shown to reduce memory requirements by more than 99% on meshes with large numbers of identical mesh cells, there are applications where this structure does not exist. The second contribution leverages a recently developed augmented Lagrangian optimization algorithm to enable r-adaptivity for meshes with the goal of enhancing the redundancies in the mesh. The third contribution extends these methods to patch-based linear solvers and preconditioners by compressing local matrices. Numerical results demonstrate the effectiveness of the proposed methods to detect, enhance and exploit mesh structure on a suite of examples inspired by large-scale applications.
This report summarizes the findings of a four months FY24 Advanced Science & Technology (AS&T) LDRD Quick Targeted Investigation (QTI) project focused on the exploration of supervised dimension reduction approaches based on autoencoders. Autoencoders have been extensively employed in literature for unsupervised learning tasks, however, their use for supervised regression tasks, which are common within scientific applications, has been limited. Motivated by linear dimension reduction strategies like Active Subspaces and Adaptive Basis, we explored the possibility of employing autoencoders to discover a non-linear manifold able to represent the original function in fewer dimensions. In this report, we discuss a neural network architecture and we perform a numerical campaign on several problems ranging from simple two-dimensional functions to a model problem for magnetohydrodynamics in five dimensions. In our preliminary results, we show that the proposed approach is found to be superior to linear dimension reduction strategies in representing the target function even with a single latent variable.
This report summarizes the work performed under the author's two-year John von Neumann LDRD project, which involves the non-intrusive surrogate modeling of dynamical systems with remarkable structural properties. After a brief introduction to the topic, technical accomplishments and project metrics are reviewed including peer-reviewed publications, software releases, external presentations and colloquia, as well as organized conference sessions and minisymposia. The report concludes with a summary of ongoing projects and collaborations which utilize the results of this work.
Hydrogen is known to embrittle austenitic stainless steels, which are widely used in high-pressure hydrogen storage and delivery systems, but the mechanisms that lead to such material degradation are still being elucidated. The current work investigates the deformation behavior of single crystal austenitic stainless steel 316L through combined uniaxial tensile testing, characterization and atomistic simulations. Thermally precharged hydrogen is shown to increase the critical resolved shear stress (CRSS) without previously reported deviations from Schmid's law. Molecular dynamics simulations further expose the statistical nature of the hydrogen and vacancy contributions to the CRSS in the presence of alloying. Slip distribution quantification over large in-plane distances (>1 mm), achieved via atomic force microscopy (AFM), highlights the role of hydrogen increasing the degree of slip localization in both single and multiple slip configurations. The most active slip bands accumulate significantly more deformation in hydrogen precharged specimens, with potential implications for damage nucleation. For 〈110〉 tensile loading, slip localization further enhances the activity of secondary slip, increases the density of geometrically necessary dislocations and leads to a distinct lattice rotation behavior compared to hydrogen-free specimens, as evidenced by electron backscatter diffraction (EBSD) maps. The results of this study provide a more comprehensive picture of the deformation aspect of hydrogen embrittlement in austenitic stainless steels.
In this study, we present a method for acquiring and characterizing novel microbial consortia that regulates methanogens and methanotrophs through selective cultivation and metagenomic analysis of indigenous microorganisms in the environment. In addition, we present the work performed as part of this project to model the pathways that act as limiting factors in microbial methane metabolism based on a carbon cycle model. In this report, we describe the methods for selective cultivation of methane-metabolism-related microorganisms from environmental samples, the method for monitoring their methane consumption performance, and the method and results for verifying their functions using quantitative PCR and metagenomics techniques. The microbial consortia containing methanotrophs were obtained through selective cultivation and molecular biological verification, and their methane consumption performance was evaluated. In addition, the potential of the existence of bacteriophages interacting with methane metabolism-related microorganisms was identified through metagenomic sequencing.
Bugs in digital logic have led to some significant security vulnerabilities. Hardware bugs are particularly troublesome since they cannot be easily patched. Additionally, if the bug is in the root of trust, all trust built upon it can be vulnerable. Traditional testing either require a deep knowledge of the system, creative attack vectors and lots of human interaction. This is not scalable as there are very few engineers that can wear the hat of a designer, a verification engineer, and a cybersecurity expert. Hardware fuzzing is a relatively new research area in dynamic hardware testing. It has proven to be an effective method for discovering bugs, unexpected behaviors, and security vulnerabilities in software. While hardware fuzzing is new to the hardware domain, it has a strong track record in software testing. Fuzzing is a testing technique that randomly mutates the input data to uncover bugs or vulnerabilities in the design. It is especially good at finding corner cases that test engineers can not envision. Another advantage over other dynamic testing techniques is that, if done well, deep knowledge of the design is not required. Additionally, fuzzing scales well. If the system is set up correctly, it can run unsupervised for weeks if necessary. In this work, we propose using hardware fuzzing to improve the input vector generation for an information flow tracking tool. To get reasonable throughput of test vectors, an emulator is targeted as the execution platform. Efficient emulator execution has some specific requirements.
his report details the findings from the research and investigation of Geometric Measures of Trustworthiness for Machine Learning Predictions. We explored the trustworthiness of machine learning (ML) models’ predictions using geometric measures to quantify the similarity of a query point with the training data. Predictive uncertainty in ML can originate from at least three sources: (1) Model uncertainty, which represents the uncertainty in model form (e.g. decision tree, vs neural network) and estimating the model parameters from the training data, (2) Data uncertainty, which represents the natural complexities of the data such as class overlap and inherent noise, and (3) Distributional uncertainty, which represents the mismatch between the training and operational distributions. The proposed measures focus on measuring and explaining the data and distributional uncertainties by measuring the relationships of operational data with the training data.
Microstructure drives component behavior. Contemporary crystal plasticity studies compare strain measurements of polycrystal specimens to models. Because each specimen is unique, it is impossible to know which differences are significant. In this project, we invented microstructure clones and explored their use in understanding crystal plasticity. Microstructure clones are specimens with nearly identical microstructures, which allows for multiple destructive tests of a microstructure, insight into how a specimen will deform, variability quantification, and the ability to measure the effects of microstructural changes. Several sets of microstructure clones, pure nickel tensile bars, were tested. The techniques of digital image correlation, crystal plasticity finite element analysis, high resolution electron backscatter diffraction, transmission electron microscopy, and dislocation dynamics were used to understand the structural behavior of these microstructures. This work reshapes the fields of crystal plasticity and structure-property relationships by providing a technique to control for specific variables, quantify microstructural stochasticity, and replicate experiments.
Agafonov, Andrei; Pineda-Romero, Nayely; Witman, Matthew D.; Nassif, Vivian; Vaughan, Gavin B.M.; Lei, Lei; Ling, Sanliang; Grant, David M.; Dornheim, Martin; Allendorf, Mark D.; Stavila, Vitalie; Zlotea, Claudia
The vast chemical space of high entropy alloys (HEAs) makes trial-and-error experimental approaches for materials discovery intractable and often necessitates data-driven and/or first principles computational insights to successfully target materials with desired properties. In the context of materials discovery for hydrogen storage applications, a theoretical prediction-experimental validation approach can vastly accelerate the search for substitution strategies to destabilize high-capacity hydrides based on benchmark HEAs, e.g. TiVNbCr alloys. Here, machine learning predictions, corroborated by density functional theory calculations, predict substantial hydride destabilization with increasing substitution of earth-abundant Fe content in the (TiVNb)75Cr25-xFex system. The as-prepared alloys crystallize in a single-phase bcc lattice for limited Fe content x < 7, while larger Fe content favors the formation of a secondary C14 Laves phase intermetallic. Short range order for alloys with x < 7 can be well described by a random distribution of atoms within the bcc lattice without lattice distortion. Hydrogen absorption experiments performed on selected alloys validate the predicted thermodynamic destabilization of the corresponding fcc hydrides and demonstrate promising lifecycle performance through reversible absorption/desorption. This demonstrates the potential of computationally expedited hydride discovery and points to further opportunities for optimizing bcc alloy ↔ fcc hydrides for practical hydrogen storage applications.
