Beyond declarations: Metrics, rankings and responsible assessment - ScienceDirect
peter.suber's bookmarks 2024-09-04
Summary:
Abstract: Responsible assessment promotes expert judgment and opposes sole reliance on research metrics when assessing research excellence. While many institutions and national research panels declare commitment to responsible assessment practices, we ask: have these declarations affected the outcomes of research evaluation? Using data from the UK's 2021 national research quality exercise and focusing on the business and management discipline, we show that the strong association between journal rankings and expert evaluations has not changed, despite institutional endorsements of DORA (Declaration on Research Assessment). Additionally, we find that this correlation is strongest for the most prestigious journals. The implications of these findings are profound: they enhance understanding of the use of metrics in research evaluations post-DORA and highlight potential constraints in the deployment of responsible assessment.