An Algorithm for Automated Rating of Reviewers.Reportar como inadecuado

An Algorithm for Automated Rating of Reviewers. - Descarga este documento en PDF. Documentación en PDF para descargar gratis. Disponible también para leer online.

The current system for scholarly information dissemination may be amenable to significant improvement. In particular, going from the current system of journal publication to one of self-distributed documents offers significant cost and timeliness advantages. A major concern with such alternatives is how to provide the value currently afforded by the peer review system. This paper proposes a mechanism that could plausibly supply such value. In the peer review system, papers are judged meritorious if good reviewers give them good reviews. In its place, the report proposes a collaborative filtering algorithm that automatically rates reviewers, and incorporates the quality of the reviewer into the metric of merit for the paper. Such a system seems to provide all the benefits of the current peer review system, while at the same time being much more flexible. The researchers have implemented a number of parameterized variations of this algorithm, and tested them on data available from a quite different application. Initial experiments suggest that the algorithm is in fact ranking reviewers reasonably. (Contains 19 references.) (Author/AEF)

Descriptors: Data Processing, Electronic Journals, Electronic Publishing, Information Dissemination, Information Processing, Information Systems, Peer Evaluation, Scholarly Communication, Scholarly Journals

Association for Computing Machinery, 1515 Broadway, New York NY 10036. Tel: 800-342-6626 (Toll Free); Tel: 212-626-0500; e-mail: acmhelp[at] For full text:

Autor: Riggs, Tracy; Wilensky, Robert



Documentos relacionados