University Research Evaluation (VRA)
The University of Bologna has a long tradition and experience in evaluating its research activities. The process began in 1997 with the establishment of the Research Observatory, with the aim of "identifying and evaluating the extent and relevance of the research carried out at the University”. In 2013, the Observatory was transformed into the University Research Evaluation Committee, a joint body tasked with preparing and updating criteria for evaluating the quality of the research carried out at the University.
The main strategic objective of the VRA is to improve the overall quality of research and increase the chances of a good outcome in national evaluations.
Over the years, the evaluation model has evolved into its present form:
- to examine the qualitative and quantitative aspects of research (quality and critical mass)
- to work on a common basis without making cross-area comparisons
- to enable the proper evaluation of departmental recruitment
In this perspective, an individual's scientific production is assessed with the aim of measuring the individual's ability to contribute to the success of the university and his or her department in the national assessment.
There is a strong link with the 'Research Quality Evaluation' (VQR) procedure introduced by the National Agency for the Evaluation of the Universities and Research Institutes (ANVUR), which has several elements common to all areas: time frame, number of products evaluated, categories and scores used for evaluation.
The qualitative assessment is complemented by a quantitative component, inspired by the National Scientific Qualification (Abilitazione Scientifica Nazionale - ASN) model, which reflects the differences between disciplines with a finer granularity than that of the field.
The results of the VRA may be used by the relevant bodies and departments to establish policies for the allocation of resources for scientific research, and to identify strategies for the development of research at the University.
The VRA process is managed through an application, which can be accessed by staff involved in the evaluation using their institutional credentials.
The lists of evaluated personnel, the evaluation criteria approved by the University bodies and all the documents relating to the procedure can be consulted on the University Intranet.
Coalition for Advancing Research Assessment (CoARA)
The Coalition for Advancing Research Assessment (CoARA) is the international coalition responsible for preparing the Agreement on Reforming Research Assessment (ARRA) and implementing its principles. ARRA provides a common direction for reforming the evaluation practices of research, researchers and research institutions, with the overall aim of maximising their quality and impact.
The University of Bologna has been a member of CoARA since November 2022, along with more than 650 organisations including public and private funding bodies, universities, research centres, institutes and infrastructures, associations and alliances, national and regional authorities, accreditation and evaluation agencies, bringing a wide variety of views and perspectives.
Since September 2023, the University of Bologna, together with the CNR, has been leading the Italian National Chapter of CoARA, which brings together 50 universities, research institutes and other organisations involved in research, with the aim of exchanging good practices and raising the national community's awareness of the methods and indicators to be adopted for an evaluation in line with the ARRA principles, with a view to mutual learning. The National Chapter also promotes discussion on the review and development of evaluation criteria, tools and processes for research organisations, researchers and projects that can be appropriately applied in the national context.
On 28 June 2023, following approval by the University's governing bodies, the University of Bologna published the Action Plan to align its research evaluation practices with the CoARA principles. The key points include the promotion of Open Science and the valorisation of a wider range of research-related contributions, the importance of qualitative evaluation, and the need to renew the tools, criteria and processes associated with research evaluation.