Publications

Forsythe, James C.; Glickman, Matthew R.; Haass, Michael J.; Whetzel, Jonathan H.

Abstract not provided.

Whetzel, Jonathan H.; Forsythe, James C.; Haass, Michael J.; Glickman, Matthew R.

Abstract not provided.

Hart, William E.; Forsythe, James C.

The authors describe a naturalistic behavioral model for the simulation of small unit combat. This model, Klein's recognition-primed decision making (RPD) model, is driven by situational awareness rather than a rational process of selecting from a set of action options. They argue that simulated combatants modeled with RPD will have more flexible and realistic responses to a broad range of small-scale combat scenarios. Furthermore, they note that the predictability of a simulation using an RPD framework can be easily controlled to provide multiple evaluations of a given combat scenario. Finally, they discuss computational issues for building an RPD-based behavior engine for fully automated combatants in small conflict scenarios, which are being investigated within Sandia's Next Generation Site Security project.

Adams, Susan S.; Davidson, George S.; Dornburg, Courtney S.; Forsythe, James C.

An experiment is proposed which will compare the effectiveness of individual versus group brainstorming in addressing difficult, real world challenges. Previous research into electronic brainstorming has largely been limited to laboratory experiments using small groups of students answering questions irrelevant to an industrial setting. The proposed experiment attempts to extend current findings to real-world employees and organization-relevant challenges. Our employees will brainstorm ideas over the course of several days, echoing the real-world scenario in an industrial setting. The methodology and hypotheses to be tested are presented along with two questions for the experimental brainstorming sessions. One question has been used in prior work and will allow calibration of the new results with existing work. The second question qualifies as a complicated, perhaps even wickedly hard, question, with relevance to modern management practices.

Abbott, Robert G.; McClain, Jonathan T.; Anderson, Benjamin R.; Nauer, Kevin S.; Silva, Austin R.; Forsythe, James C.

Abstract not provided.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Lakkaraju, Kiran; Adams, Susan S.; Abbott, Robert G.; Forsythe, James C.

In this paper we performed analysis of speech communications in order to determine if we can differentiate between expert and novice teams based on communication patterns. Two pairs of experts and novices performed numerous test sessions on the E-2 Enhanced Deployable Readiness Trainer (EDRT) which is a medium-fidelity simulator of the Naval Flight Officer (NFO) stations positioned at bank end of the E-2 Hawkeye. Results indicate that experts and novices can be differentiated based on communication patterns. First, experts and novices differ significantly with regard to the frequency of utterances, with both expert teams making many fewer radio calls than both novice teams. Next, the semantic content of utterances was considered. Using both manual and automated speech-to-text conversion, the resulting text documents were compared. For 7 of 8 subjects, the two most similar subjects (using cosine-similarity of term vectors) were in the same category of expertise (novice/expert). This means that the semantic content of utterances by experts was more similar to other experts, than novices, and vice versa. Finally, using machine learning techniques we constructed a classifier that, given as input the text of the speech of a subject, could identify whether the individual was an expert or novice with a very low error rate. By looking at the parameters of the machine learning algorithm we were also able to identify terms that are strongly associated with novices and experts. © 2011 Springer-Verlag.

Lakkaraju, Kiran L.; Adams, Susan S.; Abbott, Robert G.; Forsythe, James C.

Abstract not provided.

Forsythe, James C.; Forsythe, James C.; Bernard, Michael L.; Xavier, Patrick G.; Abbott, Robert G.; Speed, Ann S.; Brannon, Nathan B.

This project is being conducted by Sandia National Laboratories in support of the DARPA Augmented Cognition program. Work commenced in April of 2002. The objective for the DARPA program is to 'extend, by an order of magnitude or more, the information management capacity of the human-computer warfighter.' Initially, emphasis has been placed on detection of an operator's cognitive state so that systems may adapt accordingly (e.g., adjust information throughput to the operator in response to workload). Work conducted by Sandia focuses on development of technologies to infer an operator's ongoing cognitive processes, with specific emphasis on detecting discrepancies between machine state and an operator's ongoing interpretation of events.

Procedia Manufacturing

Hopkins, Shelby; Wilson, Andrew T.; Silva, Austin R.; Forsythe, James C.

Criminal forensic analysis involves examining a collection of clues to construct a plausible account of the events associated with a crime. In this paper, a study is presented that assessed whether software tools designed to encourage construction of narrative accounts would facilitate cyber forensic analysis. Compared to a baseline condition (i.e., spreadsheet with note-taking capabilities) and a visualization condition, subjects performed best when provided tools that emphasized established components of narratives. Specifically, features that encouraged subjects to identify suspected entities, and their activities and motivations proved beneficial. It is proposed that software tools developed to facilitate cyber forensic analysis and training of cyber security professionals incorporate techniques that facilitate a narrative account of events.

Wilson, Andrew T.; Forsythe, James C.; Silva, Austin R.; Hopkins, Shelby E.

Abstract not provided.

Hopkins, Shelby E.; Wilson, Andrew T.; Silva, Austin R.; Forsythe, James C.

Abstract not provided.

Forsythe, James C.; Forsythe, James C.; Speed, Ann S.; Lippitt, Carl E.; Schaller, Mark J.; Xavier, Patrick G.; Thomas, Edward V.; Schoenwald, David A.

This report documents work undertaken to endow the cognitive framework currently under development at Sandia National Laboratories with a human-like memory for specific life episodes. Capabilities have been demonstrated within the context of three separate problem areas. The first year of the project developed a capability whereby simulated robots were able to utilize a record of shared experience to perform surveillance of a building to detect a source of smoke. The second year focused on simulations of social interactions providing a queriable record of interactions such that a time series of events could be constructed and reconstructed. The third year addressed tools to promote desktop productivity, creating a capability to query episodic logs in real time allowing the model of a user to build on itself based on observations of the user's behavior.

Advances in Cognitive Engineering and Neuroergonomics

Abbott, Robert G.; Forsythe, James C.; Glickman, Matthew R.; Trumbo, Derek T.

Many enterprises are becoming increasingly data-driven. For example, empirically collected data about customer behavior offers an alternative to more traditional, synthetic techniques such as surveys, focus groups, and subject-matter experts. In contrast, recordings of tactical training exercises for the US military are not broadly archived or available for analysis. There may be great opportunity for military training and planning to use analogous techniques, where tactical scenarios are systematically recorded, indexed, and archived. Such a system would provide information for all levels of analysis, including establishing benchmarks for individual performance, evaluating the relevance and impact of training protocols, and assessing the utility of proposed systems and conops. However, such a system also offers many challenges and risks, such as cost, security, privacy, and end-user accessibility. This paper examines the possible benefits and risks of such a system with some emphasis on our recent research to address end-user accessibility.

Burnham, Laurie B.; Warrender, Christina E.; Cole, Kerstan S.; Forsythe, James C.; Haass, Michael J.; Adams, Susan S.

Abstract not provided.

Warrender, Christina E.; Cole, Kerstan S.; Forsythe, James C.; Haass, Michael J.; Adams, Susan S.

Abstract not provided.

Davidson, George S.; Dornburg, Courtney S.; Adams, Susan S.; Hendrickson, Stacey M.; Bauer, Travis L.; Forsythe, James C.

An experiment was conducted comparing the effectiveness of individual versus group electronic brainstorming in order to address difficult, real world challenges. While industrial reliance on electronic communications has become ubiquitous, empirical and theoretical understanding of the bounds of its effectiveness have been limited. Previous research using short-term, laboratory experiments have engaged small groups of students in answering questions irrelevant to an industrial setting. The current experiment extends current findings beyond the laboratory to larger groups of real-world employees addressing organization-relevant challenges over the course of four days. Findings are twofold. First, the data demonstrate that (for this design) individuals perform at least as well as groups in producing quantity of electronic ideas, regardless of brainstorming duration. However, when judged with respect to quality along three dimensions (originality, feasibility, and effectiveness), the individuals significantly (p<0.05) out performed the group working together. The theoretical and applied (e.g., cost effectiveness) implications of this finding are discussed. Second, the current experiment yielded several viable solutions to the wickedly difficult problem that was posed.

Forsythe, James C.; Abbott, Robert G.; Adams, Susan S.; Hendrickson, Stacey M.; Trumbo, Michael C.; Haass, Michael J.

Abstract not provided.

Dornburg, Courtney S.; Adams, Susan S.; Forsythe, James C.; Davidson, George S.

The present paper explores group dynamics and electronic communication, two components of wicked problem solving that are inherent to the national security environment (as well as many other business environments). First, because there can be no ''right'' answer or solution without first having agreement about the definition of the problem and the social meaning of a ''right solution'', these problems (often) fundamentally relate to the social aspects of groups, an area with much empirical research and application still needed. Second, as computer networks have been increasingly used to conduct business with decreased costs, increased information accessibility, and rapid document, database, and message exchange, electronic communication enables a new form of problem solving group that has yet to be well understood, especially as it relates to solving wicked problems.

Abbott, Robert G.; Forsythe, James C.; Haass, Michael J.; Silva, Austin R.

Abstract not provided.

Wilson, Andrew T.; Pattengale, Nicholas D.; Forsythe, James C.; Carvey, Brad

In cybersecurity forensics and incident response, the story of what has happened is the most important artifact yet the one least supported by tools and techniques. Existing tools focus on gathering and manipulating low-level data to allow an analyst to investigate exactly what happened on a host system or a network. Higher-level analysis is usually left to whatever ad hoc tools and techniques an individual may have developed. We discuss visual representations of narrative in the context of cybersecurity incidents with an eye toward multi-scale illustration of actions and actors. We envision that this representation could smoothly encompass individual packets on a wire at the lowest level and nation-state-level actors at the highest. We present progress to date, discuss the impact of technical risk on this project and highlight opportunities for future work.

Fan, Hongyou F.; Forsythe, James C.; Branda, Catherine B.; Warrender, Christina E.; Schiek, Richard S.

This report summarizes accomplishments of a three-year project focused on developing technical capabilities for measuring and modeling neuronal processes at the nanoscale. It was successfully demonstrated that nanoprobes could be engineered that were biocompatible, and could be biofunctionalized, that responded within the range of voltages typically associated with a neuronal action potential. Furthermore, the Xyce parallel circuit simulator was employed and models incorporated for simulating the ion channel and cable properties of neuronal membranes. The ultimate objective of the project had been to employ nanoprobes in vivo, with the nematode C elegans, and derive a simulation based on the resulting data. Techniques were developed allowing the nanoprobes to be injected into the nematode and the neuronal response recorded. To the authors's knowledge, this is the first occasion in which nanoparticles have been successfully employed as probes for recording neuronal response in an in vivo animal experimental protocol.

Vineyard, Craig M.; Aimone, James B.; Bernard, Michael L.; Carlson, Kristofor D.; Chance, Frances S.; Forsythe, James C.; James, Conrad D.; Rothganger, Fredrick R.; Severa, William M.; Speed, Ann S.; Verzi, Stephen J.; Warrender, Christina E.; Wagner, John S.; Miller, Leann A.

Abstract not provided.

Warrender, Christina E.; Forsythe, James C.; Ravula, Surendra K.; Keiter, Eric R.; Russo, Thomas V.; Thornquist, Heidi K.

Abstract not provided.

Forsythe, James C.; Reed, Theodore R.; Anderson, Benjamin R.; Nauer, Kevin S.; Abbott, Robert G.

Abstract not provided.

Adams, Susan S.; Cole, Kerstan S.; Haass, Michael J.; Warrender, Christina E.; Jeffers, Robert F.; Burnham, Laurie B.; Forsythe, James C.

Abstract not provided.