Network intrusion detection systems (NIDS) are commonly used to detect malware communications, including command-and-control (C2) traffic from botnets. NIDS performance assessments have been studied for decades, but mathematical modeling has rarely been used to explore NIDS performance. This paper details a mathematical model that describes a NIDS performing packet inspection and its detection of malware's C2 traffic. Here, the paper further describes an emulation testbed and a set of cyber experiments that used the testbed to validate the model. These experiments included a commonly used NIDS (Snort) and traffic with contents from a pervasive malware (Emotet). Results are presented for two scenarios: a nominal scenario and a “stressed” scenario in which the NIDS cannot process all incoming packets. Model and experiment results match well, with model estimates mostly falling within 95 % confidence intervals on the experiment means. Model results were produced 70-3000 times faster than the experimental results. Consequently, the model's predictive capability could potentially be used to support decisions about NIDS configuration and effectiveness that require high confidence results, quantification of uncertainty, and exploration of large parameter spaces. Furthermore, the experiments provide an example for how emulation testbeds can be used to validate cyber models that include stochastic variability.
Khalatpour, Ali; Tam, Man C.; Addamane, Sadhvikas J.; Reno, John; Wasilewski, Zbignew; Hu, Qing
Room temperature operation of terahertz quantum cascade lasers (THz QCLs) has been a long-pursued goal to realize compact semiconductor THz sources. In this paper, we report on improving the maximum operating temperature of THz QCLs to ∼261 K as a step toward the realization of this goal.
Herein, we report the synthesis of a novel, tetraphenylethylene-based ligand for metal-organic frameworks (MOFs). Incorporation of this ligand into a Zn- or Eu-based MOF increased the quantum yield (QY) by almost 2.5× compared to the linker alone. Furthermore, the choice of guest solvent impacted the QY and solvatochromatic response. These shifts are consistent with solvent dielectric constant as well as molecular polarizability.
See, Judi E.; Rosenfeld, Robert B.; Taylor, Sylvester; Wedic, K.M.
An analogy is drawn between the study of human behavior and the study of plutonium to demonstrate that soft and hard sciences are more similar than different, making the distinction moot and unproductive. The studies of human behavior and plutonium follow a common scientific research cycle that aligns with Thomas Kuhn’s views of scientific change. This common research cycle provides evidence that the thought processes and methodologies required for success are congruent in the soft and hard sciences. The primary implication from this analogy is that scientists in all disciplines should eradicate the distinction between soft and hard sciences. Focusing on similarities rather than differences among researchers from different disciplines is necessary to enhance collective intelligence and the type of transdisciplinary collaboration required to tackle difficult sociotechnical problems.
The resurgence of interest in hydrogen-related technologies has stimulated new studies aimed at advancing lesser-developed water-splitting processes, such as solar thermochemical hydrogen production (STCH). Progress in STCH has been largely hindered by a lack of new materials able to efficiently split water at a rate comparable to ceria under identical experimental conditions. BaCe0.25Mn0.75O3 (BCM) recently demonstrated enhanced hydrogen production over ceria and has the potential to further our understanding of two-step thermochemical cycles. A significant feature of the 12R hexagonal perovskite structure of BCM is the tendency to, in part, form a 6H polytype at high temperatures and reducing environments (i.e., during the first step of the thermochemical cycle), which may serve to mitigate degradation of the complex oxide. An analogous compound, namely BaNb0.25Mn0.75O3 (BNM) with a 12R structure was synthesized and displays nearly complete conversion to the 6H structure under identical reaction conditions as BCM. The structure of the BNM-6H polytype was determined from Rietveld refinement of synchrotron powder X-ray diffraction data and is presented within the context of the previously established BCM-6H structure.
This report describes the results of a field demonstration of the proposed surface sampling techniques and plan for the multi-year Canister Deposition Field Demonstration (CDFD). The CDFD will evaluate salt deposition rates on three commercial 32PTH2 NUHOMS welded stainless steel storage canisters in Advanced Horizontal Storage Modules. Exposure testing is planned for up to 10 years and will incorporate periodic surface sampling campaigns. The goal of the planned dust sampling and analysis is to determine important environmental parameters that impact the potential occurrence of stress corrosion cracking on spent nuclear fuel (SNF) dry storage canisters. Specifically, measured dust deposition rates and deposited particle sizes will improve parameterization of dust deposition models employed to predict the potential occurrence and timing of stress corrosion cracks on the stainless steel SNF canisters. Previously, a preliminary sampling plan was developed, identifying possible sampling locations on the canister surfaces and sampling intervals; possible sampling methods were also described. Building from previous work, this report documents hand sampling from a spent nuclear fuel canister on a transfer skid mockup designed by Sandia National Laboratories. The sampling took place from a boom lift and salts were collected from mounted sample plates. The results of these efforts are presented in this report and compared to previous laboratory-controlled tests. The information obtained from the CDFD will be critical for ongoing efforts to develop a detailed understanding of the potential for stress corrosion cracking of SNF dry storage canisters.
Engineering the transition metal dichalcogenide (TMD)-metal interface is critical for the development of two-dimensional semiconductor devices. By directly probing the electronic structures of WS2-Au and WSe2-Au interfaces with high spatial resolution, we delineate nanoscale heterogeneities in the composite systems that give rise to local Schottky barrier height modulations. Photoelectron spectroscopy reveals large variations (>100 meV) in TMD work function and binding energies for the occupied electronic states. Characterization of the composite systems with electron backscatter diffraction and scanning tunneling microscopy leads us to attribute these heterogeneities to differing crystallite orientations in the Au contact, suggesting an inherent role of the metal microstructure in contact formation. We then leverage our understanding to develop straightforward Au processing techniques to form TMD-Au interfaces with reduced heterogeneity. Our findings illustrate the sensitivity of TMDs’ electronic properties to metal contact microstructure and the viability of tuning the interface through contact engineering.
Strong and ultrastrong coupling between intersubband transitions in quantum wells and cavity photons have been realized in mid-infrared and terahertz spectral regions. However, most previous works employed a large number of quantum wells on rigid substrates to achieve coupling strengths reaching the strong or ultrastrong coupling regime. In this work, we experimentally demonstrate ultrastrong coupling between the intersubband transition in a single quantum well and the resonant mode of photonic nanocavity at room temperature. We also observe strong coupling between the nanocavity resonance and the second-order intersubband transition in a single quantum well. Furthermore, we implement for the first time such intersubband cavity polariton systems on soft and flexible substrates and demonstrate that bending of the single quantum well does not significantly affect the characteristics of the cavity polaritons. This work paves the way to broaden the range of potential applications of intersubband cavity polaritons including soft and wearable photonics.
Liquefied Petroleum Gas (LPG), as a common alternative fuel for internal combustion engines is currently widespread in use for fleet vehicles. However, a current majority of the LPG-fueled engines, uses port-fuel injection that offers lower power density when compared to a gasoline engine of equivalent displacement volume. This is due to the lower molecular weight and higher volatility of LPG components that displaces more air in the intake charge due to the larger volume occupied by the gaseous fuel. LPG direct-injection during the closed-valve portion of the cycle can avoid displacement of intake air and can thereby help achieve comparable gasoline-engine power densities. However, under certain engine operating conditions, direct-injection sprays can collapse and lead to sub-optimal fuel-air mixing, wall-wetting, incomplete combustion, and increased pollutant emissions. Direct-injection LPG, owing to its thermo-physical properties is more prone to spray collapse than gasoline sprays. However, the impact of spray collapse for high-volatility LPG on mixture preparation and subsequent combustion is not fully understood. To this end, direct-injection, laser-spark ignition experiments using propane as a surrogate for LPG under lean and stoichiometric engine operating conditions were carried out in an optically accessible, single cylinder, heavy-duty, diesel engine. A quick-switching parallel propane and iso-octane fuel system allows for easy comparison between the two fuels. Fuel temperature, operating equivalence ratio and injection timing are varied for a parametric study. In addition to combustion characterization using conventional cylinder pressure measurements, optical diagnostics are employed. These include infrared (IR) imaging for quantifying fuel-air mixture homogeneity and high-speed natural luminosity imaging for tracking the spatial and temporal progression of combustion. Imaging of infrared emission from compression-heated fuel does not reveal any significant differences in the signal distribution between collapsing and non-collapsing sprays at the spark timing. Irrespective of coolant temperatures, early injection timing resulted in a homogeneous mixture that lead to repeatable flame evolution with minimal cycle-to-cycle variability for both LPG and iso-octane. However, late injection timing resulted in mixture inhomogeneity and non-isotropic turbulence distribution. Under lean operation with late injection timing, LPG combustion is shown to benefit from a more favorable mixture distribution and flow properties induced by spray collapse. On the other hand, identical operating conditions proved to be detrimental for iso-octane combustion most likely caused by distribution of lean mixtures near the spark location that negatively impact initial flame kernel growth leading to increased cycle-to-cycle variability.
Liquefied Petroleum Gas (LPG), as a common alternative fuel for internal combustion engines is currently widespread in use for fleet vehicles. However, a current majority of the LPG-fueled engines, uses port-fuel injection that offers lower power density when compared to a gasoline engine of equivalent displacement volume. This is due to the lower molecular weight and higher volatility of LPG components that displaces more air in the intake charge due to the larger volume occupied by the gaseous fuel. LPG direct-injection during the closed-valve portion of the cycle can avoid displacement of intake air and can thereby help achieve comparable gasoline-engine power densities. However, under certain engine operating conditions, direct-injection sprays can collapse and lead to sub-optimal fuel-air mixing, wall-wetting, incomplete combustion, and increased pollutant emissions. Direct-injection LPG, owing to its thermo-physical properties is more prone to spray collapse than gasoline sprays. However, the impact of spray collapse for high-volatility LPG on mixture preparation and subsequent combustion is not fully understood. To this end, direct-injection, laser-spark ignition experiments using propane as a surrogate for LPG under lean and stoichiometric engine operating conditions were carried out in an optically accessible, single cylinder, heavy-duty, diesel engine. A quick-switching parallel propane and iso-octane fuel system allows for easy comparison between the two fuels. Fuel temperature, operating equivalence ratio and injection timing are varied for a parametric study. In addition to combustion characterization using conventional cylinder pressure measurements, optical diagnostics are employed. These include infrared (IR) imaging for quantifying fuel-air mixture homogeneity and high-speed natural luminosity imaging for tracking the spatial and temporal progression of combustion. Imaging of infrared emission from compression-heated fuel does not reveal any significant differences in the signal distribution between collapsing and non-collapsing sprays at the spark timing. Irrespective of coolant temperatures, early injection timing resulted in a homogeneous mixture that lead to repeatable flame evolution with minimal cycle-to-cycle variability for both LPG and iso-octane. However, late injection timing resulted in mixture inhomogeneity and non-isotropic turbulence distribution. Under lean operation with late injection timing, LPG combustion is shown to benefit from a more favorable mixture distribution and flow properties induced by spray collapse. On the other hand, identical operating conditions proved to be detrimental for iso-octane combustion most likely caused by distribution of lean mixtures near the spark location that negatively impact initial flame kernel growth leading to increased cycle-to-cycle variability.
Approximation algorithms for computationally complex problems are of significant importance in computing as they provide computational guarantees of obtaining practically useful results for otherwise computationally intractable problems. The demonstration of implementing formal approximation algorithms on spiking neuromorphic hardware is a critical step in establishing that neuromorphic computing can offer cost-effective solutions to significant optimization problems while retaining important computational guarantees on the quality of solutions. Here, we demonstrate that the Loihi platform is capable of effectively implementing the Goemans-Williamson (GW) approximation algorithm for MAXCUT, an NP-hard problem that has applications ranging from VLSI design to network analysis. We show that a Loihi implementation of the approximation step of the GW algorithm obtains equivalent maximum cuts of graphs as conventional algorithms, and we describe how different aspects of architecture precision impacts the algorithm performance.
Mixture formation in a hydrogen-fueled heavy-duty engine with direct injection and a nearly-quiescent top-hat combustion chamber was investigated using laser-induced fluorescence imaging, with 1,4-difluorobenzene serving as a fluorescent tracer seeded into hydrogen. The engine was motored at 1200 rpm, 1.0 bar intake pressure, and 335 K intake temperature. An outward opening medium-pressure hollow-cone injector was operated at two different injection pressures and five different injection timings from early injection during the intake stroke to late injection towards the end of compression stroke. Fuel fumigation upstream of the intake provided a well-mixed reference case for image calibration. This paper presents the evolution of in-cylinder equivalence ratio distribution evaluated during the injection event itself for the cylinder-axis plane and during the compression stroke at different positions of the light sheet within the swirl plane. During the injection event, the originally annular jet collapses onto the jet axis within 1°CA after jet emergence and within 10 mm downstream of the nozzle. Multiple shock cells are visible - their size decreases with decreasing pressure ratio. The results of the equivalence ratio distribution show high cyclic variability of mixing for all injection timings during the compression stroke, but only minor variability with early injection during the intake stroke. The ensemble-mean fuel distribution shows that fuel-rich zones shift from the intake side to the exhaust side of the combustion chamber as the injection is advanced. Probability density functions of global equivalence ratio and equivalence ratio at potential spark locations suggest that retarded fuel injection might significantly increase NO emissions and the cyclic variability of early flame kernel development.
Shunting inhibition is a potential mechanism by which biological systems multiply two time-varying signals, most recently proposed in single neurons of the fly visual system. Our work demonstrates this effect in a biological neuron model and the equivalent circuit in neuromorphic hardware modeling dendrites. We present a multi-compartment neuromorphic dendritic model that produces a multiplication-like effect using the shunting inhibition mechanism by varying leakage along the dendritic cable. Dendritic computation in neuromorphic architectures has the potential to increase complexity in single neurons and reduce the energy footprint for neural networks by enabling computation in the interconnect.
Coordinate transformations are a fundamental operation that must be performed by any animal relying upon sensory information to interact with the external world. We present a neural network model that performs a coordinate transformation from the dragonfly eye's frame of reference to the body's frame of reference while hunting. We demonstrate that the model successfully calculates turns required for interception, and discuss how future work will compare our model with biological dragonfly neural circuitry and guide neural-inspired neuromorphic implementations of coordinate transformations.
Ruiz-Gomez, Sandra; Perez, Lucas; Mascaraque, Arantzazu; Santos, Benito; El Gabaly, Farid; Schmid, Andreas K.; De La Figuera, Juan
The magnetization patterns on three atomic layers thick islands of Co on Ru(0001) are studied by spin-polarized low-energy electron microscopy (SPLEEM). In-plane magnetized micrometer wide triangular Co islands are grown on Ru(0001). They present two different orientations correlated with two different stacking sequences which differ only in the last layer position. The stacking sequence determines the type of magnetization pattern observed: the hcp islands present very wide domain walls, while the fcc islands present domains separated by much narrower domain walls. The former is an extremely low in-plane anisotropy system. We estimate the in-plane magnetic anisotropy of the fcc regions to be 1.96 × 104 J m−3 and of the hcp ones to be 2.5 × 102 J m−3
Coordinate transformations are a fundamental operation that must be performed by any animal relying upon sensory information to interact with the external world. We present a neural network model that performs a coordinate transformation from the dragonfly eye's frame of reference to the body's frame of reference while hunting. We demonstrate that the model successfully calculates turns required for interception, and discuss how future work will compare our model with biological dragonfly neural circuitry and guide neural-inspired neuromorphic implementations of coordinate transformations.
Oscillatory devices have gained significant interest recently as key components of computing systems based on biomimetic neuronal spiking. An understanding of the time scales underlying the spiking is essential for engineering fast, controllable, low energy devices. However, we find that the intrinsic dynamics of these devices are difficult to properly characterize, as they can be heavily influenced by the external circuitry used to measure them. Here we demonstrate these challenges using a VO2 Mott oscillator with a sub-100 nm effective size, achieved using a nanogap cut in a metallic carbon nanotube electrode. Given the nanoscale thermal volume of this device, it would be expected to exhibit rapid oscillations. However, due to external parasitics present within commonly used current sources, we see orders of magnitude slower dynamics. Here, we outline methods for determining when measurements are dominated by extrinsic factors and discuss the operating conditions under which intrinsic oscillation frequencies may be observed.
Rare-earth terephthalic acid (BDC)-based metal-organic frameworks (MOFs) are promising candidate materials for acid gas separation and adsorption from flue gas streams. However, previous simulations have shown that acid gases (H2O, NO2, and SO2) react with the hydroxyl on the BDC linkers to form protonated acid gases as a potential degradation mechanism. Herein, gas-phase computational approaches were used to identify the formation energies of these secondary protonated acid gases across multiple BDC linker molecules. Formation energies for secondary protonated acid gases were evaluated using both density functional theory (DFT) and correlated wave function methods for varying BDC-gas reaction mechanisms. Upon validation of DFT to reproduce wave function calculation results, rotated conformational linkers and chemically functionalized BDC linkers with −OH, −NH2, and −SH were investigated. The calculations show that the rotational conformation affects the molecule stability. Double-functionalized BDC linkers, where two functional groups are substituted onto BDC, showed varied reaction energies depending on whether the functional groups donate or withdraw electrons from the aromatic system. Based on these results, BDC linker design must balance adsorption performance with degradation via linker dehydrogenation for the design of stable MOFs for acid gas separations.
Chalcogenide thin films that undergo reversible phase changes show promise for use in next-generation nanophotonics, microelectronics, and other emerging technologies. One of the many studied compounds, Ge2Sb2Te5, has demonstrated several useful properties and performance characteristics. However, the efficacy of benchmark Ge2Sb2Te5 is restricted by amorphous phase thermal stability below ∼150 °C, limiting its potential use in high-temperature applications. In response, previous studies have added a fourth species (e.g., C) to sputter-deposited Ge2Sb2Te5, demonstrating improved thermal stability. Our current research confirms reported thermal stability enhancements and assesses the effects of carbon on crystalline phase radiation response. Through in situ transmission electron microscope irradiation studies, we examine the effect of C addition on the amorphization behavior of initially cubic and trigonal polycrystalline films irradiated using 2.8 MeV Au to various doses up to 1 × 1015 cm−2. It was found that increased C content reduces radiation tolerance of both cubic and trigonal phases.
This report describes the structure and content of an open dataset created for the purpose of testing and validating PV module temperature prediction models and their parameters. The dataset contains the main environmental parameters that affect temperature: irradiance, ambient temperature, wind speed and down-welling infrared radiation, as well as measured back-of-module temperature.
Radiation-hard high-voltage vertical GaN p-n diodes are being developed for use in power electronics subjected to ionizing radiation. We present a comparison of the measured and simulated photocurrent response of diodes exposed to ionizing irradiation with 70 keV and 20 MeV electrons at dose rates in the range of 1.4× 107 - 5.0× 108 rad(GaN)/s. The simulations correctly predict the trend in the measured steady-state photocurrent and agree with the experimental results within a factor of 2. Furthermore, simulations of the transient photocurrent response to dose rates with uniform and non-uniform ionization depth profiles uncover the physical processes involved that cannot be otherwise experimentally observed due to orders of magnitude larger RC time constant of the test circuit. The simulations were performed using an eXploratory Physics Development code developed at Sandia National Laboratories. The code offers the capability to include defect physics under more general conditions, not included in commercially available software packages, extending the applicability of the simulations to different types of radiation environments.
For computational physics simulations, code verification plays a major role in establishing the credibility of the results by assessing the correctness of the implementation of the underlying numerical methods. In computational electromagnetics, surface integral equations, such as the method-of-moments implementation of the magnetic-field integral equation, are frequently used to solve Maxwell's equations on the surfaces of electromagnetic scatterers. These electromagnetic surface integral equations yield many code-verification challenges due to the various sources of numerical error and their possible interactions. In this paper, we provide approaches to separately measure the numerical errors arising from these different error sources. We demonstrate the effectiveness of these approaches for cases with and without coding errors.
The computational modeling of nearly incompressible materials is a difficult task for many numerical methods, and even after several decades of investigation, it is still an active research area. This report seeks to address the treatment of incompressible materials in meshfree methods using a synergistic combination of two treatments. The first treatment is an $\bar{F}$ method, where the decomposed dilatational and deviatoric parts are calculated over different smoothing domains. The second treatment “activates” additional nodes throughout the domain to increase the flexibility of the model. We implement this synergistic combination in the context of the reproducing kernel particle method (RKPM) and present results for the Cook’s membrane benchmark problem. The results are compared with those using the composite tet10 finite element with a volume-averaged J formulation. We show that the combined treatment is an effective way to deal with nearly incompressible materials in a meshfree framework and compares well with other highly-effective treatments.
Plasmonic heating by nanoparticles has been used to promote a range of chemical reactions. Now, thermoplasmonic activation has been applied to latent ruthenium catalysts, enabling olefin metathesis initiated by visible and infrared light. Additionally, the desire to harness light to drive chemical transformations has surely existed as long as the study of chemistry itself. In the earliest documented applications, light was used simply as a heat source — for example, in the distillation of liquids. Since that time, our knowledge of how light and matter interact has increased exponentially, with greater mechanistic and molecular understanding enabling modern photochemists to design molecules with a myriad of finely tuned optical properties for catalysis, biochemistry, optoelectronics and more. Nonetheless, the design and optimization of molecules to achieve specific optical properties is still challenging, and for some applications, a return to the ‘simplest’ transformation — that of light to heat — can offer a more efficient approach to achieve light-mediated chemical reactions. Now, writing in Nature Chemistry, Yossi Weizmann and colleagues describe a strategy for organic and polymer synthesis driven by the conversion of light to heat.
Lankiewicz, Thomas S.; Choudhary, Hemant; Gao, Yu; Amer, Bashar; Lillington, Stephen P.; Leggieri, Patrick A.; Brown, Jennifer L.; Swift, Candice L.; Lipzen, Anna; Na, Hyunsoo; Amirebrahimi, Mojgan; Theodorou, Michael K.; Baidoo, Edward E.K.; Barry, Kerrie; Grigoriev, Igor V.; Timokhin, Vitaliy I.; Gladden, John M.; Singh, Seema S.; Mortimer, Jenny C.; Ralph, John; Simmons, Blake A.; Singer, Steven W.; O'Malley, Michelle A.
Lignocellulose forms plant cell walls, and its three constituent polymers, cellulose, hemicellulose and lignin, represent the largest renewable organic carbon pool in the terrestrial biosphere. Insights into biological lignocellulose deconstruction inform understandings of global carbon sequestration dynamics and provide inspiration for biotechnologies seeking to address the current climate crisis by producing renewable chemicals from plant biomass. Organisms in diverse environments disassemble lignocellulose, and carbohydrate degradation processes are well defined, but biological lignin deconstruction is described only in aerobic systems. It is currently unclear whether anaerobic lignin deconstruction is impossible because of biochemical constraints or, alternatively, has not yet been measured. We applied whole cell-wall nuclear magnetic resonance, gel-permeation chromatography and transcriptome sequencing to interrogate the apparent paradox that anaerobic fungi (Neocallimastigomycetes), well-documented lignocellulose degradation specialists, are unable to modify lignin. We find that Neocallimastigomycetes anaerobically break chemical bonds in grass and hardwood lignins, and we further associate upregulated gene products with the observed lignocellulose deconstruction. These findings alter perceptions of lignin deconstruction by anaerobes and provide opportunities to advance decarbonization biotechnologies that depend on depolymerizing lignocellulose.
This report describes the creation process and final content of a spectral irradiance dataset for Albuquerque, New Mexico accompanied by a set of spectral response measurements for modules deployed at the same location. The spectral irradiance measurements were made using horizontally mounted spectroradiometers; therefore, they represent global horizontal irradiance. The dataset combines non-continuous spectroradiometer and weather measurements from a two-year period into a single calendar year. The data files are accompanied by extensive metadata as well as example calculations and graphs to demonstrate the potential uses of this database. The spectral response measurements were carried out by the National Renewable Energy Laboratory using 12 commercial silicon modules types that are undergoing long-term evaluation at Sandia National Laboratories in Albuquerque.
Barekzi, Nazir; Wilkins, Meagan N.; Williams, Aumon L.; Moore, Afiya J.; Duckett, Zachary R.; Tindall, Danielle M.; Eaddy, Donnetta R.; Johnson, Mary B.; Bass, Malcolm; Mageeney, Catherine M.
Bassalto is a newly isolated phage of Mycobacterium smegmatis mc2155 from the campus grounds of Norfolk State University in Norfolk, VA. Bassalto belongs to the cluster B and subcluster B3 mycobacteriophages, based on the nucleotide composition and comparison to known mycobacteriophages.
For computational physics simulations, code verification plays a major role in establishing the credibility of the results by assessing the correctness of the implementation of the underlying numerical methods. In computational electromagnetics, surface integral equations, such as the method-of-moments implementation of the magnetic-field integral equation, are frequently used to solve Maxwell's equations on the surfaces of electromagnetic scatterers. These electromagnetic surface integral equations yield many code-verification challenges due to the various sources of numerical error and their possible interactions. In this paper, we provide approaches to separately measure the numerical errors arising from these different error sources. We demonstrate the effectiveness of these approaches for cases with and without coding errors.