A data driven approach to assess team performance through team communication
Abstract not provided.
Publications
Enhanced Training for Cyber Situational Awareness in Red versus Blue Team Exercises
This report summarizes research conducted through the Sandia National Laboratories Enhanced Training for Cyber Situational Awareness in Red Versus Blue Team Exercises Laboratory Directed Research and Development project. The objective of this project was to advance scientific understanding concerning how to best structure training for cyber defenders. Two modes of training were considered. The baseline training condition (Tool-Based training) was based on current practices where classroom instruction focuses on the functions of a software tool with various exercises in which students apply those functions. In the second training condition (Narrative-Based training), classroom instruction addressed software functions, but in the context of adversary tactics and techniques. It was hypothesized that students receiving narrative-based training would gain a deeper conceptual understanding of the software tools and this would be reflected in better performance within a red versus blue team exercise.
A Data-Driven Approach to Assessing Team Performance through Team Communication
Abstract not provided.
Human Dimension in Cyber Operations Research and Development Priorities Workshop
Abstract not provided.
Human factors in the design of a search tool for a database of recorded human behavior
Advances in Cognitive Engineering and Neuroergonomics
Many enterprises are becoming increasingly data-driven. For example, empirically collected data about customer behavior offers an alternative to more traditional, synthetic techniques such as surveys, focus groups, and subject-matter experts. In contrast, recordings of tactical training exercises for the US military are not broadly archived or available for analysis. There may be great opportunity for military training and planning to use analogous techniques, where tactical scenarios are systematically recorded, indexed, and archived. Such a system would provide information for all levels of analysis, including establishing benchmarks for individual performance, evaluating the relevance and impact of training protocols, and assessing the utility of proposed systems and conops. However, such a system also offers many challenges and risks, such as cost, security, privacy, and end-user accessibility. This paper examines the possible benefits and risks of such a system with some emphasis on our recent research to address end-user accessibility.
On Detecting Distracted Driving Using Readily-Available Vehicle Sensors: Preliminary Results
Abstract not provided.
Communications-based automated assessment of team cognitive performance
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
In this paper we performed analysis of speech communications in order to determine if we can differentiate between expert and novice teams based on communication patterns. Two pairs of experts and novices performed numerous test sessions on the E-2 Enhanced Deployable Readiness Trainer (EDRT) which is a medium-fidelity simulator of the Naval Flight Officer (NFO) stations positioned at bank end of the E-2 Hawkeye. Results indicate that experts and novices can be differentiated based on communication patterns. First, experts and novices differ significantly with regard to the frequency of utterances, with both expert teams making many fewer radio calls than both novice teams. Next, the semantic content of utterances was considered. Using both manual and automated speech-to-text conversion, the resulting text documents were compared. For 7 of 8 subjects, the two most similar subjects (using cosine-similarity of term vectors) were in the same category of expertise (novice/expert). This means that the semantic content of utterances by experts was more similar to other experts, than novices, and vice versa. Finally, using machine learning techniques we constructed a classifier that, given as input the text of the speech of a subject, could identify whether the individual was an expert or novice with a very low error rate. By looking at the parameters of the machine learning algorithm we were also able to identify terms that are strongly associated with novices and experts. © 2011 Springer-Verlag.
Individual differences and a science of human performance
Abstract not provided.
Communications-Based Automated Assessment of Team Cognitive Performance
Abstract not provided.
The Human Dimension and U.S. National Security: Our Current Challenge but Greatest Opportunity
Abstract not provided.
Toward exascale computing through neuromorphic approaches
While individual neurons function at relatively low firing rates, naturally-occurring nervous systems not only surpass manmade systems in computing power, but accomplish this feat using relatively little energy. It is asserted that the next major breakthrough in computing power will be achieved through application of neuromorphic approaches that mimic the mechanisms by which neural systems integrate and store massive quantities of data for real-time decision making. The proposed LDRD provides a conceptual foundation for SNL to make unique advances toward exascale computing. First, a team consisting of experts from the HPC, MESA, cognitive and biological sciences and nanotechnology domains will be coordinated to conduct an exercise with the outcome being a concept for applying neuromorphic computing to achieve exascale computing. It is anticipated that this concept will involve innovative extension and integration of SNL capabilities in MicroFab, material sciences, high-performance computing, and modeling and simulation of neural processes/systems.
Enhanced training effectiveness using automated student assessment
Training simulators have become increasingly popular tools for instructing humans on performance in complex environments. However, the question of how to provide individualized and scenario-specific assessment and feedback to students remains largely an open question. In this work, we follow-up on previous evaluations of the Automated Expert Modeling and Automated Student Evaluation (AEMASE) system, which automatically assesses student performance based on observed examples of good and bad performance in a given domain. The current study provides an empirical evaluation of the enhanced training effectiveness achievable with this technology. In particular, we found that students given feedback via the AEMASE-based debrief tool performed significantly better than students given only instructor feedback.
Neural assembly models derived through nano-scale measurements
This report summarizes accomplishments of a three-year project focused on developing technical capabilities for measuring and modeling neuronal processes at the nanoscale. It was successfully demonstrated that nanoprobes could be engineered that were biocompatible, and could be biofunctionalized, that responded within the range of voltages typically associated with a neuronal action potential. Furthermore, the Xyce parallel circuit simulator was employed and models incorporated for simulating the ion channel and cable properties of neuronal membranes. The ultimate objective of the project had been to employ nanoprobes in vivo, with the nematode C elegans, and derive a simulation based on the resulting data. Techniques were developed allowing the nanoprobes to be injected into the nematode and the neuronal response recorded. To the authors's knowledge, this is the first occasion in which nanoparticles have been successfully employed as probes for recording neuronal response in an in vivo animal experimental protocol.
Large-Scale Social Simulation for Engineering Strategic Communications
Sandia Cognitive Framework
Abstract not provided.
Large-Scale Social Simulation for Engineering Strategic Communications
Neurlogical Modeling Constraints: UQ from experiments to simulations
Abstract not provided.
The effectiveness of electronic brainstorming in an industrial setting
Abstract not provided.
EEG- and context-based cognitive-state classifications lead to improved team performance in a vehicle crew
Abstract not provided.
Sandia National Laboratories Cognitive Systems Technologies Overview
Abstract not provided.
Massively parallel collaboration : a literature review
The present paper explores group dynamics and electronic communication, two components of wicked problem solving that are inherent to the national security environment (as well as many other business environments). First, because there can be no ''right'' answer or solution without first having agreement about the definition of the problem and the social meaning of a ''right solution'', these problems (often) fundamentally relate to the social aspects of groups, an area with much empirical research and application still needed. Second, as computer networks have been increasingly used to conduct business with decreased costs, increased information accessibility, and rapid document, database, and message exchange, electronic communication enables a new form of problem solving group that has yet to be well understood, especially as it relates to solving wicked problems.
Assessing the effectiveness of electronic brainstorming in an industrial setting : experimental design document
An experiment is proposed which will compare the effectiveness of individual versus group brainstorming in addressing difficult, real world challenges. Previous research into electronic brainstorming has largely been limited to laboratory experiments using small groups of students answering questions irrelevant to an industrial setting. The proposed experiment attempts to extend current findings to real-world employees and organization-relevant challenges. Our employees will brainstorm ideas over the course of several days, echoing the real-world scenario in an industrial setting. The methodology and hypotheses to be tested are presented along with two questions for the experimental brainstorming sessions. One question has been used in prior work and will allow calibration of the new results with existing work. The second question qualifies as a complicated, perhaps even wickedly hard, question, with relevance to modern management practices.
Improving human effectiveness for extreme-scale problem solving : final report (assessing the effectiveness of electronic brainstorming in an industrial setting)
An experiment was conducted comparing the effectiveness of individual versus group electronic brainstorming in order to address difficult, real world challenges. While industrial reliance on electronic communications has become ubiquitous, empirical and theoretical understanding of the bounds of its effectiveness have been limited. Previous research using short-term, laboratory experiments have engaged small groups of students in answering questions irrelevant to an industrial setting. The current experiment extends current findings beyond the laboratory to larger groups of real-world employees addressing organization-relevant challenges over the course of four days. Findings are twofold. First, the data demonstrate that (for this design) individuals perform at least as well as groups in producing quantity of electronic ideas, regardless of brainstorming duration. However, when judged with respect to quality along three dimensions (originality, feasibility, and effectiveness), the individuals significantly (p<0.05) out performed the group working together. The theoretical and applied (e.g., cost effectiveness) implications of this finding are discussed. Second, the current experiment yielded several viable solutions to the wickedly difficult problem that was posed.
Yellow sticky, PHP software for an electronic brainstorming experiment
A web-based brainstorm was conducted in the summer of 2007 within the Sandia Restricted Network. This brainstorming experiment was modeled around the 'yellow sticky' brainstorms that are used in many face-to-face meetings at Sandia National Laboratories. This document discusses the implementation and makes suggestions for future implementations.
Episodic Cuing
Journal of Experimental Psychology: Learning and Memory
Abstract not provided.
Results 26–50 of 65