The first Italian research assessment exercise: a bibliometric perspective - Computer Science > Computers and SocietyReportar como inadecuado




The first Italian research assessment exercise: a bibliometric perspective - Computer Science > Computers and Society - Descarga este documento en PDF. Documentación en PDF para descargar gratis. Disponible también para leer online.

Abstract: In December 2003, seventeen years after the first UK research assessmentexercise, Italy started up its first-ever national research evaluation, withthe aim to evaluate, using the peer review method, the excellence of thenational research production. The evaluation involved 20 disciplinary areas,102 research structures, 18,500 research products and 6,661 peer reviewers1,465 from abroad; it had a direct cost of 3.55 millions Euros and a timelength spanning over 18 months. The introduction of ratings based on ex postquality of output and not on ex ante respect for parameters and compliance isan important leap forward of the national research evaluation system towardmeritocracy. From the bibliometric perspective, the national assessment offeredthe unprecedented opportunity to perform a large-scale comparison of peerreview and bibliometric indicators for an important share of the Italianresearch production. The present investigation takes full advantage of thisopportunity to test whether peer review judgements and article and journalbibliometric indicators are independent variables and, in the negative case, tomeasure the sign and strength of the association. Outcomes allow us to advocatethe use of bibliometric evaluation, suitably integrated with expert review, forthe forthcoming national assessment exercises, with the goal of shifting fromthe assessment of research excellence to the evaluation of average researchperformance without significant increase of expenses.



Autor: Massimo Franceschet, Antonio Costantini

Fuente: https://arxiv.org/







Documentos relacionados