h.Jamali at gmail dot com

1
??????? ? ?????? ????? ????????????? ? ?????????

• ???? ??? ????? ??????
• ??????? ???????
• h.Jamali at gmail dot com
• ?? ?? ????

2
?????

• ?????
• ????????? ????? ?? ?????
• ??? ?????
• ??????? ?????
• ??????? ????? ? ??? ?????
• ????????? ?????? ?????

3
Why most published research findings are
false?John. P. K. IoannidisPLoS Medicine,
2005
4
How to make more published research true.John.
P. K. IoannidisPLoS Medicine, 2014
5
?????

• ????????? ?? ??????? ?? ???? ????? ?? ???? ????
  ??? ?? ???? ??? ??????? ???? (?? ????????? ????
  ?? ??????? ?????) ???? ???????? ?? ??? ????? ????
  ???? ????? ?? ?????? ? ???????? ???? ?? ????
  ????? ???? ????? ???? ?? ?? ????? ??????? ???
  ???? ???.
• (the Economist, 15 Mar 2014) (Ioannidis, 2014)
• ??????? ? ????? ?? ???? ?????? ?? ?????? ?? ????
  ??????? ????? ????? ???? ???. ??????? ?????? ?
  ????? ?? ?????? ?? ??????????? ? ESI ???? ????
  ???
• ?????? ?????? ??.??.?? ????? ?? ???? ???? ??????
  ???? ????? ?? ???? ????? ?? ????? ????? (???
  ????????? ?? ?? ??? ?????)
• ???????? ?? ???? ?? ???? ?????? ????????! ???
  ?????

6
?????? ????? ?? ??????? ?? ???? 22860

• ?? ?? ??????? ?? ??????? ????? ?????? ?? ?? ?????
  ??? ? ??? ??? ??? ???????? ???!

7
????? ???? ??? ??? ???? ???? ?? ???? ?????? ??
???
J Bohannon, Science Mag., 2014
8
?? ??? ??????? ?? ????? ???? ?? ???? ????? ?? ???
????? ???? ????? ????? ?? ?? ????????
J Bohannon Science Mag., 201334260-65
9
????????? ????? ?? ?????

• ????? ????? ?? ?? ?????? ??? ????? ? ????? ?? ??
  ?????? ?? ???? ??? ?????? ????? ???? ??????????
  ???? ??? ????????? ? ???? ????????.
• (Lohr Carey, 1999)
• the extent to which all aspects of a studys
  design and conduct can be shown to protect
  against systematic bias, nonsystematic bias, and
  inferential error.
• Considered to be synonymous with internal
  validity
• Systematic Errors
• Include selection bias and confounding, in which
  values tend to be inaccurate in a particular
  direction
• Nonsystematic Errors
• Are attributable to chance
• Inferential Errors
• Result from problems in data analysis and
  interpretation, such as choice of the wrong
  statistical measure or wrongly rejecting the null
  hypothesis

10
??? ???? ?? ???? ????? ???

• ???? ????? ????? ?? ?????
• ????????? ??? ???????? ?? ?????
• ? ??? ???????? ????
• ?????? ???? ???? ????
• ?????? ??????? ???? ????? ????
• ?????? ??????? ???? ????? ????
• ????? ????????? ???????

11
????????? ????? ?? ?????

• ??? ????? ?? ?? ????? ?? ????? ?? ????? ??? ???
  ??? ????? ?? ????? ????? ????

12
????? ????? ? ????? ??
13
????????? ????? ?? ?????

• ?????? ?? ?? ????? ???? ???? ????? ?? ?? ??? ????
• ?????
• ????
• ????
• ?? ?? ????? ????
• ?????? ?? ??????? ????
• ????? ?? ????? ????? ???? ??? ??? ???? ????.

14
???

• ??? ?? ?? ??? ? ?? ?? ???? ??????? ?? ?????
  ??????
• ?? ??? ????? ???? ????? ???????

15
???????? ????? ?? ???? ?????
16
????? ??????? ?? ?????? ?????

• ?????? ????? ?????? ???????? ??? ? ??????
  ??????? ???- ????? ??? ??
• ?????? ????? ?? ???? ????? ??? ? ????? ?????
  ????
• ?????? ???? ????? ?????? ? ???? ?? ??? ???? ??
  ?????? ?????? ???? ??? ? ???????? ?? ???? ? ?????
• ????? ???? ????????? ? ???????? ???????? ???????
  ??????

17
????????? ????? ??? ?? ???? ??? ???

• ??????? ? ?????? ?????
• ?????? ????
• ????? ??????
• ??? ?? ??????????
• ??? ???????
• ??? ???????

18
??? ????? ??????? ? ??????

• ????????
• ????? ????
• ????? ? ????? ?????
• ???? ? ??? ????
• ???? ????? ? ????? ??????? ?? ????? ???
• ???? ????????? ??? ?????? ????????? ????? ????
• ????? ????? (???? ????? ?? ????????...)
• ?????? ??? ??????
• ???????? ?????? ???? ??????? ????
• ??????? ????? ?? ?????
• ?????? ?????? (?? ???? ????????? ????????)
• ????? ????? ??????

19
??? ????? ?????? ????

• ?????? ?? ???? ???? ?? ???? ?????? ?? ?????
• ?????? ?? ??????? ????????
• ?????? ?? ??? ????????
• ?????? ?? ???????
• ?????? ?? ????? ????
• ????? ??????? ????? ???? ????? ?? ??????
• ???? ??????? ?? ??????? ??? ?? ?????? ??????
• ???? ?????? ?????? ? ???? ?????
• ???? ?? ???? ?? ????? ???? ?????? ...
• ????? ? ???? ?? ???????? ?????
• ?????? ? ???? ??????? ????? ????
• ????? ????? ?? ????????? ????
• ????????? ???? ???? ?? ???
• ??????? ?? ??????? ???? ?? ??????????
• ????? ???? ?????? (????? ??????? ????? ??????
  ???? ?? ????? ???????? ???????? ??? ??????)

20
??? ????? ????? ??????

• ?????? ?? ???? ????? ?? ????????? ??????
• ????? ??????? ???? ????? ?? ???????? ??????? ??
  ??? ???? ???? ?????? ??????? ??????? ??????? ??
  ???? ????? ????? ??? ?? ?????
• ???? ??? ????? ?? ????? ???????? ??????? ? ??
  ?????? ???????? ??????
• ????? ????? ????? ?? ????? ?????? ?? ????????
  ???? ?? ????? ?????
• ????? ????? ????? ?? ????? ???? ??????? ?? ??? ??
  ??????
• ????? ?? ???? ?? ??? ???? ??????????
• ????? ??????? ????? ???? ?? ???????? ??????

21
??? ????? ????? ?? ??????????

• ?????? ?? ???? ??????? ??????????? ? ????????
• ???? ?? ????????? ??? ?? ????? ????? ?? ??? ?????
  ?????????? (?? ???? ????? ?? ?????)

22
??? ????? ??? ???????

• ?????? ????? ?? ????? ????? ????? ? ???????
• ?????? ????? ??????? ????? ??????? ??????? ?????
• (????? ?? ????? ?????? ????????? ? ?? ???????
  ???????)
• ???? ???? ?? ????? ????? ???? ?? ????? ???? ????
  ???????

23
??? ????? ??? ???????

• ???? ????? ????? ????? ????? ? ???????
• ????? ???????? ???? ??????? ?? ??????
• ???? ?? ???? ?????? ?? ????? ?????
• ????? ?????????? ????? ?? ???? ?? ???? ?????????
• ?????? ????? ? ???? ????? ?? ????? ?????
• ?????? ???? ?? ?????
• ???? ??? ? ??? ???? ?? ?????? ?? ???? ???? ??????
  ?? ???? ???? ???? ?? ??????
• ????? ??? ????? ?? ???? ?? ?????? ?? ?????? ??
  ???????? ?? ????? ??????? ?? ????? ????? ???
• ???????? ???? ?? ?????
• ???????? ??????? ???? ?? ????? ???? ??????? ?????
  ? ???? ?????? ?????

24
???? ????? ??? ??????? ???????

• ??? ?? ???? ????
• ??? ?? ?????
• ...

25
??????? ?????

• ??? ??????? ??????
• ??????? ???? ???? ???????
• ?????? ???? ??????? ??? ???? ?? ???????
• ????? ?????? ?????
• ????? ??????? ????? ???? ??????

26
???????????????????
27
????? ???????

• ?? ??? ??? ????? ????? ??????

28
??????? ????

• ?????? ???? ?????? ?????
• ?????? ?????
• ?????? / ???? ??????
• ?????? ??????
• ???? ????
• ??????? ?????
• ??? ?????
• ???????????
• ?????? ??????
• ????????? ?????? ????

29
??????? ??????

• ????? ?????
• ??????
• ??? ?????? /?????? ????
• ?????? ?????? ?? ?? ?????

30
??????? ????

• ????????
• ????? ? ????? ????
• ??????? ???????
• ???? ?? ????? (??????????)
• ????? ?? ???? (?????? ??????)
• ?
• ?? ?????? (????? ???????)
• ??? ?????? (????? ?????? ????? ??? ???????)

31
????? ?????? ? ?????????? ???? ??? ?????

• Becker Medical Library Model for Assessment of
  Research Impact
• Canadian Institutes of Health Research Framework
• Excellence in Research for Australia
• Logic Model for Medical Research
• Leiden University Medical Center
• Integrative mixed-methods approach
• National Health and Medical Research Council of
  Australia Measure of Research Impact and
  Achievement
• Medical Research Council UK,
• Economic Impact Reporting Framework
• Michael Smith Foundation for Health Research,
  Performance Measurement Evaluation Framework
• Payback model
• Research Excellence Framework
• Research Impact Framework
• Assessment tool

32
??? ?????

• ???? ???? ?????? ?????? ????? ?? ??????? ?????
  (????) ????? ????? ???. ??? ????? ???? ?????????
  ?? ????? ?????? ?????? (? ?? ??? ?? ???????? ?
  ???????? ????? ???? ???? ????) ? ?? ?????? ??????
  ?? ???? ? ???? ????? ?????? ?????? ???
• ?? ???????? ??? ????????? ?????? ????? ? ??????
  ??????? ??????
• ??? ??????? ????? ?????? ??? ??? ?? ???? ???????
  ??????????
• ????? ?????????? ??? ???????? ????? ???
• ????????? ????????? ?????? ?????? ?????? ????
  ?????

33
?????? ????? ????? payback
34
???? ???? ????? ? ????? ????? ????? payback
???? ?????
????? ???? ???????? ????? ???? ????????? ???? ????? ?????.
??????? ?????? ????? ? ??? ??? ???? ???? ????????? ?????? ????? ???????? ??????? ????? ? ????? ??????? ????? ????? ???? ??????? ????? ?? ????????? ?????? ????? ????? ?????? ? ????? ??????.
????????? ??????? ? ????? ????? ??????? ????? ????? ?? ?? ????? ?? ??????? ????? ? ?????? ????? ???? ????????? ?????? ? ????????? ????????? ?????? ? ???????? ?? ???????? ??????? ? ???????? ???? ?? ???? ????????? ????? ????? ???????.
????? ????? ? ??? ????? ???? ????? ?? ????? ????? ?????? ????? ????? ?? ?????? ????? ?????? ?????? ??????? ????? ??????? (???? ?????? ?????)? ?????? ?? ?? ????? ???? ????? ?????????? ????? ?? ??? ?????? ??? ???? ? ????? ????? ????? ???????? ???? ?? ???? ?????? ????.
????? ??????? ?????? ????? ??????? ?????? ?? ?? ???? ?????? ?? ????? ???? ?? ?????? ?????? ?? ????? ????? ??? ????.
35
???????? ? ????? ????? ?? ????? ?????? ??????
????????? ???? ?? ??????? ?????
????? ???? ??????? ????? ? ????? ??? ???? ???? ????
???? ???? ????? ? ??? ???? ????? ????????? ????? ???????? ? ????? ??
????? 1? ??????? ????? ???? ????? ????? ????? ???? ??????? ????? ????? ????
????? 2? ????????? ????? ????? ????? ???? ??????? ?????? ??????? ?? ??? ????????? ?????? ???? ??? ??????? ??????
????? 3? ?????????? ??????? ????? ????? ????????? ???????? ??? ?????? ?????? ????? ?????? ????? ?? ?????? ?????? ????? ????
???? ?? ????? ????????? ??????? ?? ????? ?? ????? / ???? ?? ????? ???? ???????? ????? ???? ?? ??????
????? 4? ?????????? ?????? ?????????? ? ????? ????? ??????? ????? ?? ????? ?? ????? ?????
????? 5? ?????? ???? ???? ???? ? ?????????? ??????? ????? ?? ????? ?????? ?? ??????????
????? 6? ?????????? ????? ??????? ????? ?? ????? ???????
36
??? ????????

• ???? ????? ????????? ??????? ?????? ???? ????
  ???????? ????? ? ?????? ?????? ?? ????? ?????
  ????? ???
• ????? ?? ????? ?????? ?????? ???
• ??? ?????? ??? ???? ?? ????????? ?? ?? ??? ????
• ????? ????
• ???????? ????? ? ????? ????
• ????? ???? ?? ?????
• ????? ????? ? ??? ?????
• ????? ???????

37
(No Transcript)
38
??? ??????- ???????? ??????? ???????? ? ?????
???????
39
?????
40
??? ??????? ?? ??? ????? ??????? ????
????? ????
????? ????? ???????? ??????? ????????? ? ????????? ????? ????? ?????? ????????? ???? ???? ?????? ???????? ???? ???? ???? ????????? ? ?????? ???????? ? ???????
????? ??????? ???????? ???? ???? ?????? ???? ????? ?? ????? ???????? ?????? ?? ????? ???????? ????? ??????? ????????? ? ????????
???????? ????? ? ?? ?????? ????? ??? ??? ?? ???? ????? ?????
??????? ????? ? ?????????? ?????????? ??????? ???????? ????????? ? ?????? (???? ?? ?????) ??????
????? ???? ????? ????? ???? ???? ?????
41
??? ????? - ?????
????? ????
??????? ??? ????? ???? ??????? ??? ???? ????????? ????? ???????
????? ??? ????? ???? ????? ????? ????? ?? ?????? ?? ??????? ?????
????? ?????? ?? ????? ??????? ?? ?????? ??????? ?????? ??????? ?????? ?????? ?????
????? ?? ??? ? ????? ????? ?? ????? ??????? ????? ???? ?????? ? ??????? ?????? ??????? ?? ??????? ???
??????? ??????? ???? ???????? ????? ??? ????? ????? ????? ? ?????? ?????
42
????? ???? ????? ? ????????

• ?????????? ?? ????????? ?? ?? ???? ????? ?? ???
  ????? ?? ??????? ?? ????? ??? ? ???????? ??? ??
  ????? ?? ???? ?? ?? ???? ????? ???????.

43
?? ???? ????? ???? ?????

• ??????????-???? ??? ???? ?? ???????? ?? ?????
  ????? ??????? ?? ??????? (?????????? ?????) ???
  ??????? ??????? ?? ??????? ????? ?? ????? ??????.
  ?? ???? ????? ?? ???? ?? ????? ??? ???? ?? ?????
  ????? ????? ???? ??????? ?? ??? ??????? ?????? ??
  ???.
• ?????-???? ??? ???? ?? ???????? ?? ????? ?????
  ??????? ?? ????? ?? ????? ???????? ??????? ??
  ????? ??????? ???????? ? ????????? ???? ??? ????
  ?????? ?? ???? ?????. ????? ?? ??? ?? ????? ???
  ??? ?? ??????? ?????? ????? ?????? ??????? ??
  ????? ????? ?? ????? ? ???? ?? ?? ??? ??? ?????.
• ????? ??? ???? ?? ???????? ?? ????? ?????
  ??????? ?? ?? ????? ????? ? ?? ????? ?? ??
  ??????? ??????? ?? ????? ?? ????? ???????.

44
Producer-push
45
User- pull
46
exchange
47
????????? ????????? ???? ????? ?? ?????
?? ??????? ???? ?? ??? ????? ???? ????. ???? ????
?????? ?? ????? ???? ???? ?? ????? ?????? ??
????????? ?????? ???. ???????????? ?????? ??
????????? ???? ????? ???? ????
48
... ?? ???????? ? ???????
49
... ?? ????????
50
???????? ???? ?????? ????? ?? ??? ???????

• ????? ????? ?? ?????
• ????? ????? ???????? ? ???? ???? ?????? ??? ?????
• ??? ?????
• ?????? ??????
• ????? ????

51
??????? ?????? ????? ?????

• ???????? ?? ???? ?????? ?????? ????? ?????
  ???????
• ????? ????????? ?? ????? ???? ?? ???? ??????? ?
  ??????
• ?????? ????? ?????
• ??? (???????? ?????????? ????? ??????? ??????
  ???????? ???????? ???? ? ?????)
• ?? ?????? ????? (????????? ?????????? ?????
  ?????????? ? ???? ???????)
• ????? ??????????
• ??????? ????? ????????
• ????????????? ???????? ? ????????
• ?????? (????????) ????????????? ???? ?????
  ?????? ?? ??????
• ????? ?????????? ? ????? ?????
• ????? ???? ????? ? ?????????

Ioannidis, 2014
52
??????? ?????? ????? ?????

• ????? ?? ?????? ??? ????? ??? ?? ?????? ???????
  ????? ????? ???
• ???? ???? ?????? ?????? (?????? ?????)
• ?????? ??? ?????? (effect size) ???
• ?????? ?????? ?? ??? ?????? ?????? ???????? ?
  ???????? ????? ???? ????
• ????? ???? ? ????????? ?????? ???? ????
• ? ....

53
??????? ?????? ???

• ??? ??????? ?? ?? ??? ??????
• ?? ??? ???????? ?? ????? ??? ?????? ????? ?????
• ?? ?? ????? ??????? ?? ????? ??? ?????? ?????
• ????? ??? ???? ?? ??? ???? ??? ??? ????? ?????
• ????? ??? ???? ???? ??? ???? ???? ??? ????? ?????

54
????????????? ??? ??? ?? ?????

• ????? ????? ?? ????? ?????? ????
• ????? ?????? ?? ?????? ???? ? ????? ????
• ????? ?? ????? ??????
• ????? ????? ? ??????? ????? ?? ??????? ????

55
????????????? ??? ?? ??? ?????

• ?????? ? ?????? ????
• ???????? ???? ?? ??? ?? ????? ???? ? ??? ????
• ????? ????? ?? ?? ????? ????? ????

56
????????????? ??? ?????? ????????

• ?? ????? ??????? ???? ?????

57
????? ??????

• ?? ???? ???????? ??????? ?? ???? ?????? ????????
  ?? ?? ???? ?? ????? ? ???????? ???? ?? ??? ?????
  ?? ??? ?????? ??? ???? ??????? ????? (???? ?????)
  ?? ??????? ?? ???
• Australian Journal of Basic and Applied Science
• ????? ??? ???? ?? ???? ?? ?? ???? ???? ??? ???
  ???? ????????? ?????????? ?? ???. ?? ????? ????
  ??? ???? ?? ???? ????? ??? ?????????? ???? ?? ???
  ?? ???????? ?? ???? ??????? ?? ???? ???? ?? ??
  ??? ??? ???? ???? ??? ? ?? ??? ???? ????? ?????.
  ?? ??? ?? ??? ???????? ???? 296640 ???? ????
  ?????? ???????????? ?? ??? ???? ?????? ???????.

58
???? ?????? ???? ???????? ??????? ????? ?????? ???
59
http//scholarlyoa.com/publishers/
60
http//scholarlyoa.com/individual-journals/
61
????????? ????? ?? ????? ??? ???? (251 ????? 2013)

• ????? ??? ????????? ???? ?? ??? ???? ? ???? ??
  ????? ?? ??? ????? ???? ??? ???? ??? ?????? ???
  ???. ???? ???? ?????? ????????? ?? ????? ?????
  ???? ???? ????? ??? ?? ?????????? ????? ???? ???
  ? ???? ???? ?????? ????????? ?? ??? ????? ?????
  ????? ? ?? ????? ???? ???.
• (????? ???? ???? ???? ??? ??????? ???????)

62
Who publishes in predatory journals?

• Statistical analyses verify that each group of
  journals has a distinct author population. Those
  who publish in predatory journals are, for the
  most part, young and inexperienced researchers
  from developing countries. We believe that
  economic and sociocultural conditions in these
  developing countries have contributed to the
  differences found in authorship between
  predatory and nonpredatory journals
• http//dx.doi.org/10.1002/asi.23265

63
????????????? ??? ?????? ????????-?????

• ???? ??? ?? ?? ???? ???? ???? ???? ?? ?? ????
  ????? ???
• ????? ??? ?? ?? ???? ???????? ???? ?? ????? ???
  ?????? ???? ????
• ?? ???????? ???? ???? ??????? ?????? ?? ?????
  ??????? ????
• ?? ???????? ??? ????? ???? ???? ?? ?? ????? ?????
  ?? ??????? ???
• ??? ????? ?? ??? ? ???? ???? ??? ??????? ????
• ?????? ?? ?? ???????? ????? ????? ????
• ???? ??? ?? ?? ????????? ????? ? ???????? ?????
  ????? ?????

64
????????????? ??? ??????? ???? ? ????

• ?????? ???? ??? ?? ?????? ????
• ???? ???? ??? ????? ?????? ????? ??
• ?????? ????
• ????? ?? ???????? ???
• ?????? ?? ?????? ?????
• ???? ???? ?? ????
• ???? ? ???? ??????? ?????
• ????? ????? ???????

65
????????????? ??? ??? ??? ?????

• ReaderMeter
• Google Scholar Profile
• ResearcherID
• Microsoft Academic Search
• Scopus Author Identification
• ORCID
• GrowKudos
• Biomedexperts
• Mendeley
• PMC, European pubmed
• Open access

66
(No Transcript)
67
AltMetrics
68
(No Transcript)
69
????????????? ??? ? ??? ????? ??????

• ?????? ?? ????? ?????? ?????? ?? ????? ??? ?? ??
  ?????? ??????
• ?????? ?? ????? ?????? ????? ??? ?????? ? ....
• Dryad
• Databib
• GenBank
• Journal articles supplements
• NIH Data Sharing Repositories (USA)
• Digital Curation Centre (UK)

70
???????? ?? ??? ?????

• ?????? ?????
• ?????? ????????

71
???????????? ?????

• ???? ????
• ????? ? ????? ????????? ?? ????? ???? ?? ????
  ??????? ? ??????
• ????? ??????? ??? (???????? ?????????? ?????
  ??????? ?????? ???????? ???????? ???? ? ?????)
• ????? ????????? ? ?????? ???? ?? ???? ????? ?????
• ????? ???????????? ??? ?????
• ????? ?????? ??????????? ? ????? ????? (?????????
  ????? ??????..)
• ??????? ???? ? ????? ???? ????? ????? ?? ????
  ????????? ? ???? ?????

72
????? ?????? ????????

• ???? ???? ???? ????? ?? ???????? ?????? ????
• ??? ????? ????? ???????
• ?????? ? ????? ?? ????????? ?? ???? ?? ???? ?????
  ?????? ??? ?????? ??? ? ...
• ?????? ?? ???? ????? ????? ? ?????? ???? ?????
• ??? ????? ? ?????? ?? ????? ????????
• ???? ?????? ???? (?????? ???? KTCN)
• ????? ??? ??? ????? Meta-Research Innovation
  Center at Stanford U.

73
https//becker.wustl.edu/impact-assessment/
74
????? ?????? ????????

• ??????? ?? ??????? ?? ??????? ???? ?????? ?
  ?????????
• ??????? ???? ??????? ?????? ??? ? ????? ?? ????
  ????? ?? ???? ???? ????? ???
• ?? ???????? ????? ???? ????? ???? ?? ?? ??? ??
  ???????? ???? ?? ?? ??????? ?? ??????? ???? ?????
  ???? ?? ???????? ????? ??? ?? ???? ????? ? ?????
  ?? ?? ?????? ?????
• ???? ?? ????? ?? ????? ???????? ??????

75
?????

• ???? ????? ???????? ?? ???? ?????? ???? ?????
  ????? ? ???? ?? ???? ??? ?? ???? ????? ???? ????
• ??????? ????? ??????? ???? ????? ????? ????.
  ???1. ???? ??? ????? ?? ???? ????? ?????? ?
  ??????? ????? ????????? ???? ?????
• Ioannidis JPA (2014) How to Make More Published
  Research True. PLoS Med 11(10) e1001747. doi
  10.1371/journal.pmed.1001747
• Ioannidis JPA (2005) Why Most Published Research
  Findings Are False. PLoS Med 2(8) e124. doi
  10.1371/journal.pmed.0020124
• Lohr KN, Carey TS. Assessing best evidence
  issues in grading the quality of studies for
  systematic reviews. Jt Comm J Qual Improv
  199925470-9.

76

• ???
• ????
• ?????