PowerPointPrsentation

1
Deutsche Forschungsgemeinschaft
The Use of
Research Funding Databases for
Research Assessment
Information Systems
Presented at the 8th international Conference
onCurrent Research Information Systems May
11-13th, 2006 in Bergen, Norway Daniel Bovelet,
German Research Foundation (DFG) Department of
Information Management
DFG
www.dfg.de
2
1 Agenda
Page 2 of 9
Agenda

• Short Introduction into research assessment
  systems and the DFG Funding Ranking
• Development of Research Assessment Information
  Systems based on research funding databases

DFG
8th international Conference on Current Research
Information Systems (2006 in Bergen, Norway)
3
2 Research Assessment Systems and the DFG Funding
Ranking
Page 3 of 9
Idea of Research Assessment Systems

• Systems of research assessment, such as ranking
  exercises, are internationally discussed as
  important strategic management tools for publicly
  funded research institutions and, more than ever,
  are becoming determinants for research policy
  decision-making processes. Idea
• To give information on research activity and
  quality of research institutions
• To inform about the disciplinary research
  profile of these institutions
• To inform about regional research clusters and
  networks in science

New approach of the DFG Funding Ranking

• The research indicators are primarily derived
  from process produced databases covering funding
  processes of research funding agencies
• No surveys, no biliometric data only funding!

History of the DFG Funding Ranking

• First Ranking in 1997 DFG funding instruments
  and programmes
• Second Ranking 2000 new regional aggregation of
  data
• Third Ranking 2003 new networks in science
• new several other indicators based on
  heterogeneous research funding databases
• Fourth Ranking 2006 gt Extended Version new
  indicators, detailed analysis of 14 research areas

DFG
8th international Conference on Current Research
Information Systems (2006 in Bergen, Norway)
4
3 Developement of a CRIS based on the DFG Funding
Ranking
Page 4 of 9
Research Assessment Information System covering
14 research areas
Institutional Reports - Geographical Information
Systems - Network Analytical Representations
integration
research indicators
The different properties of funding databases can
be used for the derivation of research indicators
suitable for the representation of the research
activities and achievements of research
institutions differentiated by several units of
analysis (e.g. scientific disciplines)
derivation of indicators
consolidation of heterogeneous databases
unique framework for the subject classification
concordance/classifications for institutional
codes
standardization process
Research Funding Databases (DFG funding
reviewers, AvH, DAAD, Bund, EU, StatBund)
DFG
8th international Conference on Current Research
Information Systems (2006 in Bergen, Norway)
5
3.1 Data sources and the need of standardization
processes
Page 5 of 9
STANDARDIZATION
research area classifications
institutional classifications
research funding and infrastructural data
research institution
research area
HETEROGENEOUS RESEARCH FUNDING DATABASES
Other Research Councils
Government
Foundations
Federal Statistical Office
Business and Industry
International Organisations
DFG
DFG
8th international Conference on Current Research
Information Systems (2006 in Bergen, Norway)
6
3.2 Institutional reports
Page 6 of 9
Characteristics
Example for institutional reports

• Enable comprehensive information on the
  parameter values of the research indicators
• Several indicators can be examined in an overall
  context for each research institution
• For the representation and interpretation of the
  respective values, the relation to a specific
  benchmark (e.g. by using ranking groups) should
  be taken into consideration
• The information system is additionally able to
  provide qualitative information on the
  institution and its infrastructure (e.g. titles
  of funded research
  programmes)

Figure on the University of Munich

• The report offers information on three goups of
  research indicators financial capital structure,
  the human resources and indicators suituable for
  the representation of the internationality
• The research indicators can be differentiated
  according to scientific discipline or research
  funding programmes...

DFG
8th international Conference on Current Research
Information Systems (2006 in Bergen, Norway)
7
3.3 Geographic Information Systems
Page 7 of 9
Characteristics
Example for cartographical representations

• Using a GIS in the context of several types of
  research indicators provides perspectives on the
  various research institutions and surrounding
  regions with their scientific infrastructure
• The figures provide insight into the research
  regions and enable regional focal points to be
  identified
• Several levels of analysis can be displayed for
  different indicators, such as an overall view for
  Germany, distributions for the federal states, or
  allocation by administrative districts

Figure on allocations of DFG approvals

• The data is processed in such a way that
  conclusions are drawn according to administrative
  rural and urban districts
• A district code is assigned to each institution
  implemented in the research institution directory
  and standardized (address) database
• For institutions located at multiple locations,
  each site is allocated ist own code

DFG
8th international Conference on Current Research
Information Systems (2006 in Bergen, Norway)
8
3.4 Network Analytical Representations
Page 8 of 9
Characteristics
Example for Network Analytical Representations

• The network or relationship structures between
  research institutions can be visualized in the
  form of network analytical representations
• The graphs can be analysed in the following way
• institutions that are central to the structure
  are positioned centrally
• institutions that interact frequently are
  positioned close to each other
• the line thickness indicates the frequency of
  interaction between two institutions
• the diameter of circles represents the total
  number of interactions

Figure on DFG coordinated programmes

• The relationship structure results from joint
  participation of institutions in DFG coordinated
  programmes
• The figure shows the core network in biology

DFG
8th international Conference on Current Research
Information Systems (2006 in Bergen, Norway)
9
Deutsche Forschungsgemeinschaft
Thank you for your attention!
More Infos at www.dfg.de/
Daniel Bovelet, Department of Information
Management Daniel.Bovelet_at_dfg.de
DFG
www.dfg.de