Research Institute

1
Research Institutes CRIS as a Source of Data for
Assessing Research Results

• Sergey Parinov, CEMI RAS
• Socionet project

2
How we can develop CRIS to provide

• complex, detailed and accurate data for better
  assessing research results and researchers by
• Higher Attestation Commission (VAK) experts
• Research Foundations, e.g. Russian Foundation for
  Basic Research to evaluate proposals
• Managers of research organizations to make right
  motivations of scientists
• CRIS has to be a part of research e-infrastructure

3
What we can develop in CRIS and in research
e-infrastructure

• Tools for electronic depositing of research
  results to give experts full and accessible set
  of research results
• Tools and services for linking relative research
  materials and maintaining networks of such
  relations to give experts complexity of data
• Tools and services for better research results
  usage and its monitoring to give experts more
  accurate and realistic data for research
  assessments

4
Full and accessible data on research results

• CRIS provides a tool for electronic depositing by
  researchers of all their research results (as
  articles)
• Research e-infrastructure provides an
  integration mechanism to build an unified
  information space from local CRISs data
• Interactions between local CRISs and integration
  mechanism can based on OAI-PMH protocol and CERIF
  data format
• Current problem lack of motivation for
  researchers

5
Electronic depositing tools

• There are many systems, which support OAI-PMH
  protocol (Eprints, Dspace, Socionet Personal
  Zone, etc.) and few of them supporting CERIF
  format (e.g. SPZ)
• Using Socionet Personal Zone (spz.socionet.ru)
  services a researcher can
• Deposit his/her single materials in thematic
  series of Socionet Open Archive
• Create and maintain any number of different types
  own series (preprints, postprints, personal and
  institution profiles, news, comments, projects,
  thesis, etc.) collecting any number of
  materials/articles

6
Institutional Repository (IR) Tools

• Using Socionet Personal Zone a research institute
  can integrate all types series created by
  different people from their staff as IR with
  OAI-PMH/CERIF features
• Many people from the institute can create and
  maintain their thematic collections of research
  materials and institutes admin can integrate it
  as IR
• By this way research institutes of Social Science
  Section of RAS built 21 IR, and as a result
  Russia moved to 14 position in an international
  rating

7
IRs in Russia (October 2008)
??_??????????? ??????-??????????????? ????? ???? ???    (???? 2008-01-16 )  ????? ??????? ?????????????
??_????? ???????????????? ???????????? ???    (???? 2007-12-10 )  ???????? ???? ?????????
??_???????? ????????? ? ??????????? ????????????? ???????????? ?? ???    (???? 2007-12-04 )  ???????? ????? ???????????
??_????????? ????????????? ????????????? ? ???????????? ???????????? (?????? ????????? ????????? ???)    (???? 2007-12-04 )  ???????? ??????? ????????????
??_???????? ?????? ???    (???? 2007-11-26 )  ?????????? ????? ???????????
??_???????? ????????? ?????????? ???????? ????    (???? 2007-11-26 )  ?????????????? ?????? ?????????
??_???????? ??????????? ? ????? ???    (???? 2007-11-26 )  ????????? ????? ??????????
??_???????? ??????? ????????? ? ????????????? ????????? ?????????? ???????? ????    (???? 2007-11-26 )  ????????? ??????? ????????????
??_???????? ??????? ???????????? ?????????    (???? 2007-11-26 )  ??? ??????? ????????
??_???????? ?????????-????????????? ???????????? ????????? ???????? ?????? ???    (???? 2007-11-26 )  ??????? ???? ????????
??_????????? ??????-????????????????? ????? ?????????? ???????? ????    (???? 2007-11-26 )  ???????? ????? ??????????
??_???????? ????????????????????? ???????????????    (???? 2007-11-26 )  ??????? ???????? ????????
??_???????? ????????? ?????????? ???????? ????    (???? 2007-11-25 )  ??????? ??????? ????????
??_???????? ???????? ??????? ?????????? ???????? ????    (???? 2007-11-25 )  ?????? ?.?.
??_???????? ????????????? ??????? ????????? ???????? ?????? ???    (???? 2007-11-25 )  ?????????? ????? ??????????
??_?????-????????????? ?????????-?????????????? ???????? ???    (???? 2007-11-25 )  ????? ?.?.
??_??????????????? ???????? ?????????? ???????? ???? (?????? ???????????????? ??????????)    (???? 2007-11-25 )  ???????? ???? ??????????
??_???????? ??? ? ?????? ?????????? ???????? ????    (???? 2007-11-24 )  ???????? ?.?.
??_????????? ????????????? ????????????? ? ???????????? ???????????? (?????? ????????? ????????? ???)    (???? 2007-11-24 )  ???????? ?.?.
??_??????????? ?????????-?????????????? ???????? ?????????? ???????? ????    (???? 2007-11-24 )  ???????? ?.?.
??_???????? ??????? ????? ???    (???? 2007-11-24 )  ??????????? ?.?.
8
Russia in IRs international rating (September
2008)

• ?????? ???-?? ??
• United States 225
• United Kingdom 108
• Germany 86
• Brazil 55
• Japan 46
• Canada 44
• France 40
• Sweden 35
• Australia 34
• Spain 32
• Italy 31
• India 28
• Netherlands 23
• Russian Federation 20

Source http//roar.eprints.org/index.php?actionb
rowse
9
Leading Russian Research Institutes by IRs
characteristics
Institute Name Number of materials in IR Number of series in IR
1. ???????? ????????? ? ??????????? ????????????? ???????????? ?? ??? 11323 13
2. ??????????? ?????????-?????????????? ???????? ??? 2356 15
3. ???????? ????????? ??? 838 24
4. ???????? ??????? ????? ??? 712 8
5. ???????? ????????????????????? ??????????????? ??? 281 6
6. ??????????? ??????-??????????????? ????? ???? ??? 158 4
7. ???????? ????????????? ??????? ????????? ???????? ?????? ??? 147 6
8. ???????? ????????? ??? 139 7
9. ????????? ????????????? ????????????? ? ???????????? ???????????? (?????? ????????? ????????? ???) 100 8
10. ???????? ??? ? ?????? ??? 96 8
11. ???????? ???????? ??????? ??? 74 6
12. ???????? ?????????-???????????? ???????????? ??? 59 4
10
Example of series structure of IR(for IEIE SB
RAS)
Series Title Number of materials
???????????? ???????????, ???????? ? ?????? 1
???????????? ?????????? ??????????? 23
?????? "?????? ????????? ? ??????????" 449
??????? ??????? ????? ?? ??? 246
??????????, ????????, ???????? ??????????? ????? ?? ??? ?? ???????????? ???????? ? 1990 ?. 139
??????? ????? ?? ??? 15
??????????????? ??????? ????? ?? ??? 7
?????? ? ??????? ? ??????-??????????????? ???????????? ????????? ? ?????, ????????????? ? ?????????????? ????? ?? ??? 7
????????? ??????????? ????? ?? ??? ?? ???????????? ???????? ? 1990 ?. 183
?????????? ???????? ?????? 41
?????????? ??????????? ????? ?? ??? ?? ???????????? ???????? ? 1990 ?. 611
?????????? ????? ?? ??? 17
????? ??????????? ?????? 9767
11
Example OAI-PMHCERIF support for IR at Socionet
12
Complexity of data on research results

• CRIS provides a tool to make thematic links
  between relative materials located at any part
  of unified information space
• Research e-infrastructure provides a service to
  support such links and tools to maintain networks
  of such relations
• Basic information objects for linking are
• a research article or a material
• personal profile of a researcher
• institution profile

13
Example of types of linking for a research
article
14
Links as a graph
15
Example of types of links for a personal profile
16
Example of types of links for an institution
profile
17
Needed development

• Adding to CERIF a set of specifications for
  global thematic links between information
  objects
• how to provide global unified ID for objects from
  local CRIS
• open format for specifying links between objects
• open list of links types

18
Accurate and realistic data for research results
usage assessment

• CRIS provides a tool to use (cite) research
  results in advanced and improved form located in
  any other CRIS
• Research e-infrastructure provides a service to
  support such advanced citations
• A focus on building a new advanced model to make
  electronic citations in deposited research
  articles/materials

19
Electronic citation tool

• To make citation as a one of thematic links
  between fragments of articles located in any
  CRIS
• Each citation link includes a set of quality
  attributes of usage type and a field for notes
• Making a citation an author specifies linked
  fragments of texts, selects usage type and can
  fill in a note

20
Quality attributes of electronic citation

• Making a citation an author should select one or
  many of quality attributes to specify how (s)he
  uses the cited research result. Suggested usage
  types
• grounds for receiving my results, which means
  direct scientific use of cited result by the
  author
• proof of cited result, i.e. the result of the
  author proves the cited one
• cited result proves result, obtained by the
  author previously, i.e. the author states
  his/her priority with regard to independently
  obtained cited result
• similar or related result, meaning that the
  author in a certain sense repeated the cited
  result
• illustration of my conclusions, implying
  certain logical link between the result of the
  author and the cited one
• object for criticism, means that the author
  doubts the cited result.

21
Electronic citation output new data for research
assessment

• who and how uses certain research results as the
  basis for own scientific argument these cases
  mean direct utilization of results and increase
  indicator of its using
• which results prove or are proved by other
  results, which should enhance the indicator of
  the proved results credibility
• which results repeat the existing ones, which
  should increase the degree of both results
  credibility
• which results use as general illustrations than
  means a case of weak usage of results
• who criticizes which results

22
Needed development

• Adding to CERIF a citation type of links with a
  set of quality attributes and a note field
• Provide an open list of quality attributes for
  citation links