The University of Glasgow has developed a policy on the use of quantitative indicators in research evaluation that aligns with the principles of the Leiden Manifesto. In the statement, the university commits to:
1. Adopt assessment procedures that are evidence-based
2. Apply quantitative indicators responsibly by using a defined and balanced set of measures that are normalised by subject.
3. Declare the quantitative indicators used, and apply them fairly and consistently.
4. Evaluate researchers based on performance across different dimensions, with expectations set in advance and clearly communicated to researchers.
5. Undertake regular review of the quantitative indicators.
The statement on the use of quantitative indicators in research evaluation can be found here. It is located within a larger suite of policies governing research at the university that can be found here. The University is in the process of writing an annual statement on research culture in which they will detail their implementation plan.
Thank you Arş. Gör. Demet Işık and Prof. Dr. Özlem Gökkurt Demirtel for translating the Leiden Manifesto into Turkish. The translations page now provides a Turkish translation.
Thank you Eleonora Dagienė for translating the Leiden Manifesto into Lithuanian. The translation is now posted on our translations page.
In April, CWTS, Leiden will offer a short course addressing the key issues related to responsible uses of metrics in research management and research evaluation. In addition to theoretical, conceptual, and methodological approaches, a variety of case studies will be presented to illustrate issues related to responsible metrics. LM authors Sarah de Rijcke, Ludo Waltman, and Ismael Rafols, will be joined by Stephen Curry. Curry is one of the initiators of DORA and chair of the DORA steering committee.
Find more information here.
In 2017 the government of Indonesia introduced a scoring system for all academics in the country that combines data from Scopus and Google Scholar with information submitted by Indonesian academics to track published papers, citations, and researchers’ h-index. These numbers are used to calculate a personal score that is taken into account when academics apply for research grants; a high score may also help with promotions and salary negotiations. The system generated controversy after national awards were given to the top scorers who were subsequently show to have achieved their scores by gaming the system.
The Chemical & Engineering News story on the controversy quotes LM author Ludo Waltman. Find the article here.
Science also covered the story and quotes LM author Diana Hicks. Find that article here.
The Russian Council for the Ethics of Scientific Publications of the Association of Scientific Editors and Publishers has published an open appeal to those who develop and implement quantitative indicators of publication activity. The document, inspired by the Leiden Manifesto, is signed by 21 eminent scholars. It proposes 12 principles tailored to the Russian context. Google translate generated a very nice translation into English, so the text should be accessible to all. Find it here.
With the posting of an Italian translation, we now have 20 translations of the Leiden Manifesto. Thanks go to Edoardo Milotti of Università di Trieste for producing this latest translation. The Leiden Manifesto has been translated into: Chinese, Traditional Chinese, Basque, Catalan, Czech, Danish, Finnish, French, German, Indonesian, Italian, Japanese, Korean, Persian, Portuguese, Russian, Serbian, Slovak, Spanish, and Swedish.
We would like to thank Surya Dalimunthe and Afrilya from the Indonesian Open Science Team for translating the Leiden Manifesto into Indonesian. The translation is now mounted on our translations page.
In light of rumours that only DORA signatories will have access to UKRI funding in future, Lizzie Gadd explains why Loughborough has chosen an alternative path up the ‘responsible metrics mountain’, and why she believes all ‘mountain-climbers’ should be equally supported and rewarded.
See the full blog post here
Let’s move beyond the rhetoric: it’s time to change how we judge research
Five years ago, the Declaration on Research Assessment was a rallying point. It must now become a tool for fair evaluation, urges Stephen Curry in his call to begin changing research management practice:
There have been many calls for something better, including the Leiden Manifesto and the UK report "The Metric Tide', both released in 2015. Like DORA, these have changed the tenor of discussions around researcher assessment and paved the way for change.
It's time to shift from making declarations to finding solutions. . . .
Stephen Curry, writing in Nature, 8 February 2018, vol. 554, p. 147