Internet Assisted Review

1
Internet Assisted Review

• Focus Group
• March 14, 2002

2
Agenda

• Reviewer Conflicts - Self Identified
• Documents available in IAR
• Peer Review IAR Control Center
• User Registration
• Log on to IAR
• Account Management and Account Info Look Up
• Post and Edit Phase
• Read Only Phase

3
Reviewer Conflicts - Self Identified

• How should system allow Reviewer to identify
  conflicts?
• Only once when they log in to IAR for the first
  time?
• Anytime?

4
Documents in IAR

• Items currently mailed to Reviewer
• Reviewer Guidelines
• Cover Letter
• Grant Application
• Prior Summary Statements
• Program Announcements
• Meeting Roster
• Blank Conflict of Interest Form
• Questions
• Are the documents above needed in IAR?
• Who provides electronic copies of these
  documents?
• What should be the process for getting these
  documents into IAR?

5

• Peer Review IAR Control Center
• (Release Meeting to IAR)
• Refer to Scope Document Excerpt,
• Product Features 5.2

6

• Pre-Registration System Process
• and
• User Registration
• Refer to Scope Document Excerpt,
• Product Features 5.3, 5.4

7
Registration - Enter PIN Sample Screen
8
Registration Invalid PINSample Screen
9
Registration - Account CreationSample Screen
10
PIN MismatchSample Screen
11
Registration SuccessSample Screen
12

• Log on to IAR
• Refer to Scope Document Excerpt,
• Product Features 5.5

13
IAR Log on Sample Screen
14

• Account Information Look Up
• Refer to Scope Document Excerpt,
• Product Features 5.6

15
Account Information Look UpSample Screen
16
User Name/Password SentSample Screen
17

• Account Access and Expiration
• Refer to Scope Document Excerpt,
• Product Features 5.7

18

• Post and Edit Phase
• Refer to Scope Document Excerpt,
• Product Features 5.8

19
Reviewers List of Meetings

• This is the first screen that appears for
  Reviewers after login (Commons Account).
• The screen lists all meetings that include
  applications assigned to the logged in Reviewer.
• Screen will show Meeting Identifier, SRA Name,
  Critique Due Date, Meeting Dates, Post-Mtg Edit
  End Date.
• Reviewer clicks Meeting Identifier for list of
  their assigned applications.
• Could this same screen work for SRAs?

20
Reviewers List of MeetingsSample Screen
21
Application List (during Post-Edit Phase)

• Reviewer will see their assigned applications for
  the meeting they selected. (Reviewers with
  Non-Commons accounts will automatically see their
  applications list when they log in.)
• Screen will show Meeting Identifier and critique
  submission due date and the following for each
  application application number, project title,
  PI name (new PI indicator), Assignment Role
  (Primary, Secondary, etc.), Score, Critique
  Submitted Date and Action (View or Post)

22
Application List (during Post-Edit Phase)
continued

• Reviewer clicks on Action choices to View or Post
  critique.
• Reviewer can only post and view critiques for
  applications assigned to them.
• User will be able to sort list by any of the
  column headings (Score, Application Number, etc.)
• Will this same screen work for SRAs (show all
  applications for their meeting)?

23
Application ListSample Screen
24
Upload Critique Preliminary Score

• Reviewer clicks on Post hyperlink.
• Screen shows Application Number, Title, PI Name,
  Reviewer Type and Preliminary Score (if
  available)
• Screen allows critique and/or score to be
  submitted.
• Button is provided for browsing their computer to
  locate and upload the file containing the
  critique.
• Score can be entered.

25
Upload Critique Preliminary Score Sample Screen
26

• Read Only Phase
• Refer to Scope Document Excerpt,
• Product Features 5.8

27
Read-Only Phase

• After the Critique Submission deadline, Reviewers
  may read all critiques for the meeting (except
  COI and where blocked by SRA).
• Reviewer names are not displayed on screen or in
  critique, only type (Primary, Secondary, etc.) is
  displayed
• User clicks View hyperlink to view a critique
• Questions
• Where should Reviewer name be displayed with
  critique?
• Will Reviewers or SRA/GTA need to view multiple
  critiques?
• If so, how?
• All critiques for one application merged into one
  document?
• All critiques for entire meeting merged into one
  document?

28
Read-Only Phase Sample Screen
29

• During Post and Edit Phase What are the
  differences between what the SRA/GTA should see
  and the Reviewer should see?
• What are the differences during the Read Only
  Phase?

30

• Minutes and meeting related documents will be
  posted at http//era.nih.gov/areas/rev/index.cfm
• Next Focus Group Meeting
• Monday, March 18, 2002, 130 4 pm
• NGIT/Logicon Large Conference Room (1700
  Research Blvd)
• Agenda will include Demonstrations of the NIAID
  Electronic Review (ER) system and the NCI
  Clinical Trials Evaluation Program(CTEP)

31

• Thanks for your participation!