Responsible research assessment
The University of Groningen has approved principles to promote the responsible assessment of research. This applies to evaluation of both individual researchers and of our major units of research assessment, our SEP institutes. The latter are evaluated once every six years following the national Dutch Strategy Evaluation Protocol (SEP), as part of our quality assurance cycle, described at our Quality Assurance Research pages. Evaluation of individual academic staff requires balanced assessment of one’s contributions to teaching, research, societal impact, open science, and team performance, as described at our Recognition & Reward web pages.
Below, we summarize evaluation practices to avoid and positive alternatives to adopt in research assessment, and in the recruitment, recognition and reward of individual researchers.
These principles are intended for all UG members who are involved in the assessment of researchers, research proposals or research teams, as well as for those who are the subject of such assessments.
Practices to avoid
-
Avoid “quick and dirty” assessment of research based solely on narrow quantitative metrics such as journal name, JIF, h-index, or number of publications and raw citation counts taken in isolation.
-
Do not use metrics designed to evaluate journals as a surrogate measure of article quality or in hiring and promotion decisions.
-
Do not rank based on insignificant decimal places.
-
Do not take a lack of available quantitative data as an indicator of performance.
Responsible practices
-
When assessing researchers, consider individual differences and highlights from their entire portfolio of activities and contributions.
-
When using metrics, make sure to:
- balance quantitative assessment with expert peer-review,
- use more than one metric to ensure robustness,
- use normalized metrics to account for field, date and output type,
- account for years active in academia when assessing ECRs. -
If research metrics are used in recruitment, promotion, nominations or other processes, clearly outline this in application documents.
When choosing to use research metrics, the selected metrics and their application should comply with the points above, and the principles they are based on. For further information, please consult the resources below.
About the principles
The Responsible Research Assessment principles are aligned with the most important international and national best practices, including:
-
Agreement on Reforming Research Assessment of the EU (ARRA),
The initiative to create these principles was led by the Research & Impact Cluster of University Services and Research Intelligence Services (RISe). In co-creating the principles, they were assisted by the University Committee for Academic Practice (UCW), UG Expert Network for Research Analytics (ENRA), HR, Young Academy Groningen (YAG), and the Recognition and Rewards Workgroup which have all provided valuable input and feedback.
Nine responsible research assessment principles
-
Research performance metrics should be used to support, not replace qualitative or peer assessment.
-
Measure performance against the mission of the research institute, or the specific aims and ambitions of the group or researcher.
-
Keep research assessment data and analysis open and transparent.
-
Provide information on the strengths and weaknesses of metrics and select metrics that are fit for purpose
-
Be mindful of the nature of different disciplines and variation in research practices
-
When assessing researchers, consider individual differences and highlights from their entire portfolio of activities and contributions
-
Avoid misplaced concreteness and false precision
-
Avoid research assessment practices which introduce bias
-
Ensure that metrics are used in a responsible and expert manner at the UG
Each of the nine principles is explained in more detail in the full text of the Responsible Research Assessment Principles [PDF].
Guidance for hiring, evaluations and award panels
To support the practical implementation of the Responsible research assessment principles, we have developed Guidance for hiring, evaluations and award panels. You can find these guidelines below.
Public DORA statement UG
In October 2024, our University signed the San Francisco Declaration on Research Assessment (DORA). Our DORA statement can be found below.
CoARA Action Plan UG
In September 2023, our University joined the Coalition for Advancing Research Assessment (CoARA). An outline of our plans and actions to implement the ten ARRA commitments can be found below.
Do you have a question or would like to give us your feedback? Contact dr. Jules van Rooij, Senior Advisor Research Policy, University Services, Research & Impact, Talent Funding & Quality.