Wargames are a common tool for investigating complex conflict scenarios and have a long history of informing military and strategic study. Historically, these games have often been one offs, may not rigorously collect data, and have been built primarily for exploration rather than developing data-driven analytical conclusions. Experimental wargaming, a new wargaming approach that employs the basic principles of experimental design to facilitate an objective basis for exploring fundamental research questions around human behavior (such as understanding conflict escalation), is a potential tool that can be used in combination with existing wargaming approaches. The Project on Nuclear Gaming, a consortium involving the University of California, Berkeley, Sandia National Laboratories, and Lawrence Livermore National Laboratory, developed an experimental wargame, SIGNAL, to explore questions surrounding conflict escalation and strategic stabil-ity in the nuclear context. To date, the SIGNAL experimental wargame has been played hundreds of times by thousands of players from around the world, creating the largest data-base of wargame data for academic purposes known to the authors. This paper discusses the design of SIGNAL, focusing on how the principles of experimental design influenced this design.
We report that over the past century, and particularly since the outset of the Cold War, wargames (interactive simulations used to evaluate aspects of tactics, operations, and strategy) have become an integral means for militaries and policy-makers to evaluate how strategic decisions are made related to nuclear weapons strategy and international security. Furthermore, these methods have also been applied beyond the military realm, to examine phenomena as varied as elections, government policy, international trade, and supply-chain mechanics. Today, a renewed focus on wargaming combined with access to sophisticated and inexpensive drag-and-drop digital game development frameworks and new cloud computing architectures have democratized the ability to enable massive multiplayer gaming experiences. With the integration of simulation tools and experimental methods from a variety of social science disciplines, a science-based experimental gaming approach has the potential to transform the insights generated from gaming by creating human-derived, large-n datasets for replicable, quantitative analysis. In the following, we outline challenges associated with contemporary simulation and wargaming tools, investigate where scholars have searched for game data, and explore the utility of new experimental gaming and data analysis methods in both policy-making and academic settings.