Proposal evaluation in health research

1
Proposal evaluationin health research

• Eligibility/Exclusion check
• Evaluators
• Evaluation procedure
• Main reference documents
• Ethical review

2
Proposal evaluation in health research
Principles

• Quality
• Transparency
• Equality of treatment
• Impartiality
• Efficiency
• Ethical considerations on all proposals

3
Evaluators
Proposal evaluationin health research

• Appropriate range of competencies
• Appropriately balanced academic,
  industrial, end-user
• Geographical balance
• Gender balance
• Rotation (at least 25 replaced each year)
• Independent observers

4
Proposal evaluation in health research

• Eligibility/Exclusion check (before evaluation)
• Eligibility criteria
• Date and time of receipt of the proposal
• Minimum of eligible, independent partners
• Completeness of the proposal (forms and
  descriptive part)
• Scope (for clear cut cases)
• Budget thresholds where appropriate

5
Proposal evaluation in health research

• Reduced number of evaluation criteria
• Scientific qualityquality of objectives and
  concept, state of the art, methodology
• Implementationcompetence of the partners,
  quality of the consortium (complementarity),
  managerial approach, allocation and
  justification of the resources to be committed
  (budget, staff, equipment)
• Impactimpact as set out in the work programme,
  dissemination activities and IPR management where
  appropriate

6
Evaluation in FP7
7
Proposal evaluation in health research

• Remote individual evaluation by
  external experts
• - briefing before evaluation
  - individual evaluation forms to be filled out,
  signed and scored for each criterion
  - scores/marks 0 5 -
  minimum overall threshold 10 (4, 3, 3)

half marks may be given
8
Proposal evaluationin health research

• Consensus meetings in Brussels
• consensus for individual criteria minimum 3-5
  experts/proposal
• Taking reviewer opinions into consideration
• Writing up comments for the criteria
• Writing consensus reports for all proposals
• For proposals above threshold making
  recommendations for negotiations

9
Proposal evaluation in health research

• Panel meeting of consensus group experts tasks
• Comparing proposals to recommend the best and
  most appropriate proposal(s) according to the
  call specifications
• Panel proposes a priority order based on final
  scoring

10
Proposal evaluationin health research

• Main reference documents for evaluation
• Work Programme and call fiche
• Guides for proposers, including proposal length
  restrictions!!!
• Rules on proposal submission, evaluation,
  selection and award procedures
• Rules for participation

11
Methodology of Ethical Review

• MAJOR CHANGES FROM FP6 TO FP7
• The Ethic Review will be carried out on the
  proposal submitted
• No additional information will be requested from
  the consortium
• The Consortium is asked to submit drafts of
  Information Sheet and Consent Form
• The Consortium does not need to submit copies of
  legislation

TAKE HOME MESSAGE GET IT RIGHT FIRST TIME!