The Diverse Variables To Consider When Planning and Assessing Public Research Portfolios
Abstract not provided.
Abstract not provided.
Research Evaluation
Current policy and program rationale, objectives, and evaluation use a fragmented picture of the innovation process. This presents a challenge since in the United States officials in both the executive and legislative branches of government see innovation, whether that be new products or processes or business models, as the solution to many of the problems the country faces. The logic model is a popular tool for developing and describing the rationale for a policy or program and its context. This article sets out to describe generic logic models of both the R&D process and the diffusion process, building on existing theory-based frameworks. Then a combined, theory-based logic model for the innovation process is presented. Examples of the elements of the logic, each a possible leverage point or intervention, are provided, along with a discussion of how this comprehensive but simple model might be useful for both evaluation and policy development. © Beech Tree Publishing 2010.
Abstract not provided.
Objectives of the Office of Energy Efficiency and Renewable Energy (EERE) 2009-2010 Studies (Solar, Wind, Geothermal, & Combustion Engine R&D) are to: (1) Demonstrate to investors that EERE research and technology development (R&D) programs & subprograms are 'Worth It'; (2) Develop an improved Benefit-Cost methodology for determining realized economic and other benefits of EERE R&D programs - (a) Model government additionality more thoroughly and on a case-by-case basis; (b) Move beyond economic benefits; and (c) Have each study calculate returns to a whole EERE program/subprogram; and (3) Develop a consistent, workable Methods Guide for independent contractors who will perform the evaluation studies.
There has been a concerted effort since 2007 to establish a dashboard of metrics for the Science, Technology, and Engineering (ST&E) work at Sandia National Laboratories. These metrics are to provide a self assessment mechanism for the ST&E Strategic Management Unit (SMU) to complement external expert review and advice and various internal self assessment processes. The data and analysis will help ST&E Managers plan, implement, and track strategies and work in order to support the critical success factors of nurturing core science and enabling laboratory missions. The purpose of this SAND report is to provide a guide for those who want to understand the ST&E SMU metrics process. This report provides an overview of why the ST&E SMU wants a dashboard of metrics, some background on metrics for ST&E programs from existing literature and past Sandia metrics efforts, a summary of work completed to date, specifics on the portfolio of metrics that have been chosen and the implementation process that has been followed, and plans for the coming year to improve the ST&E SMU metrics process.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Proposed for publication in the Academy of Management Review.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Proposed for publication in Research Technology Management.
Abstract not provided.
Abstract not provided.
This report describes the process and results from an effort to develop metrics for program accomplishments for the FY 1997 budget submission of the U.S. Department of Energy Environmental Management International Technology Integration Program (EM-ITI). The four-step process included interviews with key EM-ITI staff, the development of a strawman program logic chart, and all day facilitated workshop with EM-ITI staff during which preliminary performance plans and measures were developed and refined, and a series of follow-on discussions and activities including a cross-organizational project data base. The effort helped EM-ITI to crystallize and develop a unified vision of their future which they can effectively communicate to their own management and their internal and external customers. The effort sets the stage for responding to the Government Performance and Results Act. The metrics developed may be applicable to other international technology integration programs. Metrics were chosen in areas of eight general performance goals for 1997-1998: (1) number of forums provided for the exchange of information, (2) formal agreements signed, (3) new partners identified, (4) customers reached and satisfied, (5, 6) dollars leveraged by EM technology focus area and from foreign research, (7) number of foreign technologies identified for potential use in remediation of DOE sites, and (8) projects advanced through the pipeline.
The objective of the workshop was to promote discussions between experts and research managers on developing approaches for assessing the impact of DOE`s basic energy research upon the energy mission, applied research, technology transfer, the economy, and society. The purpose of this impact assessment is to demonstrate results and improve ER research programs in this era when basic research is expected to meet changing national economic and social goals. The questions addressed were: (1) By what criteria and metrics does Energy Research measure performance and evaluate its impact on the DOE mission and society while maintaining an environment that fosters basic research? (2) What combination of evaluation methods best applies to assessing the performance and impact of OBES basic research? The focus will be upon the following methods: Case studies, User surveys, Citation analysis, TRACES approach, Return on DOE investment (ROI)/Econometrics, and Expert panels. (3) What combination of methods and specific rules of thumb can be applied to capture impacts along the spectrum from basic research to products and societal impacts?