NIDA - About NIDA - Organization - NACDA - Minutes... -
[Cached Version]
Published on: 9/15/1998
Last Visited: 12/2/2007
Elliot Postow, Ph.D. - Center for Scientific Review, NIH
...
Report on Review of NIDA Neuroscience and AIDS Science at the Center for Scientific Review - Dr. Elliot Postow
Dr. Postow reported on results from the recent review cycle, which was the first to include NIDA's neuroscience and AIDS applications in the newly constituted Center for Scientific Review (CSR) review groups.CSR has committed itself to on-going evaluation of the integration activities and has applied for and received "1% evaluation funds" to monitor the integration.Cautioning that interpretation is limited by the small numbers of applications involved, he presented data on the outcomes of reviews of neuroscience applications.His general conclusions were that there was much variability over different scientific review groups, that NIDA applications were about as likely to be scored at the 25th percentile or better as others, and that usually the number of unscored NIDA applications was comparable to the number of unscored applications from other NIH Institutes.
...
Dr. Postow presented data to suggest the percent of unscored applications was not affected, and the overall CSR median score moved from 240 to 265.Further, the distribution of scores was flattened.Dr. Postow concluded that the review groups are scoring, overall, as requested and implementing the score changes fairly.Council asked about the basis of calibration for "unscoring".Dr. Postow replied that the traditional adjectives were no longer being used, so the frame of reference is the grants one is "used to seeing" recently.Council raised the issue of round-to-round variability in the quality of applications, and Dr. Postow noted CSR has examined variability in scores, which is not an equivalent concept.Council sought and received assurance that applicants are being informed about the scoring changes.Council discussed the importance of keeping in mind that the purpose of the scores is to help make funding decisions and that this is especially difficult around the "payline margins."Finally, a member noted that reviewers need adequate orientation to the changes.
After Dr. Postow's presentation, Council decided to form a subcommittee to monitor the impact of integration and the reviews of NIDA applications.