National peer-review research assessment exercises for the hard sciences can be a complete waste of money: the Italian case

31 Oct 2018  ·  Abramo Giovanni, Cicero Tindaro, D'Angelo Ciriaco Andrea ·

There has been ample demonstration that bibliometrics is superior to peer-review for national research assessment exercises in the hard sciences. In this paper we examine the Italian case, taking the 2001-2003 university performance rankings list based on bibliometrics as benchmark. We compare the accuracy of the first national evaluation exercise, conducted entirely by peer-review, to other rankings lists prepared at zero cost, based on indicators indirectly linked to performance or available on the Internet. The results show that, for the hard sciences, the costs of conducting the Italian evaluation of research institutions could have been completely avoided.

PDF Abstract
No code implementations yet. Submit your code now

Categories


Digital Libraries

Datasets


  Add Datasets introduced or used in this paper