Evaluation of proposed and existing accelerated research programs by the Office of Naval Research

A process to evaluate proposed and existing accelerated research programs is described. The key component of the process is the use of mixed level review panels, consisting of bench-level researchers, research managers, transitioning experts, technology experts, and Navy requirements experts, to review multiple programs (nominally) in technical areas of similar science. The operational components of the review process are described in detail, and results of experiments in which program presentation, evaluation, and discussion times were varied are presented. Application experience of the process to Office of Naval Research program evaluation is presented