Publications

2 Results

Search results

Jump to search filters

Verifying LLM generative agents reflect human behavior in contested information environments to effectively simulate disinformation campaigns (Proteus)

Kemp, Emily L.; Lancaster, Caitlin M.; Morris, Elizabeth S.; Salmon, Madison M.; Compton, Jonathan E.; Firestone, Sarah A.

Disinformation poses a significant and evolving threat to today’s online environment. Individuals encounter challenges in detecting disinformation, subsequently influencing their behavior and decision-making processes. Our research examines the potential use of large language model (LLM) generative agents (LGAs) to replicate human behavior to better understand how disinformation is spread in online environments. Using human subjects research, we first investigate how personality traits, individual differences, and demographic factors relate to decision-making in simulated online disinformation environments. Then, we examine whether LGAs can effectively replicate human responses in the same simulated online environments when assigned personality traits, demographic characteristics and behavioral attributes. Our findings indicate that LGAs can align with human decisions in these scenarios; however, alignment is contingent upon scenario context, persona settings and LLM selection. Results provide valuable insights for methodology refinement in future research and in utilizing LGAs to model complex national security challenges such as disinformation campaigns.

More Details

Activity Theory Literature Review

Greenwald-Yarnell, Megan L.; Divis, Kristin M.; Fleming, Elizabeth S.; Heiden, Siobhan M.; Nyre-Yu, Megan; Odom, Peter W.; Pang, Michelle A.; Salmon, Madison M.; Silva, Austin R.

Complex challenges across Sandia National Laboratories' (SNL) mission areas underscore the need for systems level thinking, resulting in a better understanding of the organizational work systems and environments in which our hardware and software will be used. SNL researchers have successfully used Activity Theory (AT) as a framework to clarify work systems, informing product design, delivery, acceptance, and use. To increase familiarity with AT, a working group assembled to select key resources on the topic and generate an annotated bibliography. The resources in this bibliography are arranged in six categories: 1) An introduction to AT; 2) Advanced readings in AT; 3) AT and human computer interaction (HCI); 4) Methodological resources for practitioners; 5) Case studies; and 6) Related frameworks that have been used to study work systems. This annotated bibliography is expected to improve the reader's understanding of AT and enable more efficient and effective application of it.

More Details
2 Results
2 Results
Top