Office of Medical Education

1
Office of Medical Education

• November 25, 2008
• Thomas M. Hill, Ph.D.
• Director, Office of Medical Education

2
OME Accomplishments 2007-08

• 1. Made improvements to the Interprofessional
  Healthcare course, including rewriting of two
  clinical cases.
• 2. Conducted facilitator training workshops for
  new PCL facilitator recruits. Trained additional
  faculty members from other programs (Nursing,
  CSD, Social Work) for the Interprofessional
  Healthcare course.
• 3. Conducted the sixth Medical School for the
  Public (Drugs and Bugs), with statewide coverage
  via collaboration with the information technology
  unit.

3
OME Accomplishments 2007-08

• 4. Organized PCL and IPC Curriculum for the tenth
  academic year. Revised and added new cases to
  curriculum. Involved new clinical faculty in the
  Friday Case Wrap-up sessions. Increased
  utilization of OME clinical faculty in IPC
  clinical skills and ACE Program. Integrated
  clinical skills teaching in Year 01 with PCL Case
  sequences. Continued the Honors grade in Year 02.
  
• 5. Continued to collect and evaluate data
  documenting effectiveness of medical education
  program including end of block surveys in Years
  01 and 02.

4
OME Accomplishments 2007-08

• 6. Expanded the use of the Clinical Education
  Center by other programs (Nursing, PA, CLS,
  Sports Medicine, Psychology, PT).
• 7. Reformatted the regularly-scheduled research
  meetings in OME to provide feedback on ongoing
  research projects in OME.
• 8. Continued to teach the Senior Elective in
  Medical Education. Continued to utilize Year IV
  students in case-writing program.

5
OME Accomplishments 2007-08

• 9. Conducted pilot study for PCL small group
  experience in Block VIII. Purpose of study was
  to increase student learning and retention by
  increasing use of discussions in small group
  experience. Survey conducted after the study
  showed that students were highly enthusiastic
  about implementing a similar process in Year II
  of the curriculum.
• 10. Published seven manuscripts and presented
  sixteen abstracts at national and international
  meetings.

6
Student Performance

• 1. No significant change in average scores on
  Multiple Choice Exam, Case Exam, or Clinical
  Skills Exams.
• 2. Remediation numbers are high only in Block I.
• 3. Block failures remained at similar levels to
  previous years.
• 4. Significant drop in Block satisfaction scores
  throughout Year 2 blocks last year.

7
Students Overall Satisfaction with Block - Year
One(1 Very Dissatisfied 5 Very Satisfied)
8
Students Overall Satisfaction with the Block -
Year Two(1 Very Dissatisfied 5 Very
Satisfied)
9
Student Performance

• 1. No significant change in average scores on
  Multiple Choice Exam, Case Exam, or Clinical
  Skills Exams.
• 2. Remediation numbers are high only in Block I.
• 3. Block failures remained at similar levels to
  previous years.
• 4. Significant drop in Block satisfaction scores
  throughout Year 2 blocks.
• 5. USMLE Step 1 scores matched national average.

10
USMLE Step 1 (First Time Examinees)Mean Scores
of 1997-2009 Graduating Classes(Note that
vertical axis is truncated. Minimum passing
185.)
11
USMLE STEP 1 High PerformersNumber of UND Scores
at or above 240(1997-2010 Graduating Classes)
12
USMLE Step 2Mean Scores of 1997-2008 Graduating
Classes(Note that vertical axis is truncated.
Minimum passing 184.)
13
Faculty Performance

• 1. No significant change in Facilitator
  evaluation scores.
• 2. No significant change in Lecture evaluation
  scores.
• 3. Unable to award Outstanding Lecturer Awards in
  several late blocks due to low numbers of
  students filling out lecture evaluations.

14
Facilitator Evaluation Mean Scores -
2007-2008(Horizontal line indicates overall
mean) 1 Strongly Dissatisfied 5 Strongly
Satisfied
2006/2007
1
2
3
4
5
6
7
8
Block
15
Lecture Evaluation Mean Scores -
2007-2008(Horizontal line indicates overall
mean) 1 Strongly Dissatisfied 5 Strongly
Satisfied
2006/2007
16
Mean Response Rate on Student Lecture
Evaluations(per Lecturer and by Class)
Year 1
Year 2
Class of
Block
17
Faculty Evaluations by Students

• 1. Students are being asked to fill out an
  excessive number of evaluations (gt100 different
  evaluations each year).
• 2. New proposal for faculty lecture evaluations
• Only one-quarter of class fills out evaluations,
  but must evaluate all lecturers that are due for
  evaluations.
• Reduce number of faculty evaluations by
• Concentrating on new lecturers and faculty
  coming up for promotion and tenure.
• Limit number of evaluations on a lecturer to
  once every two blocks.
• However, ALL FACULTY should be evaluated at least
  once each year.

18
Goals for 2008-09

• 1. Complete review of entire medical curriculum
  through the MCC and generate recommendations for
  improvements to curriculum. Develop plan to
  implement those recommendations in ensuing years.
• 2. Upgrade the video technology in the Clinical
  Education Center.
• 3. Conduct pilot studies for Peer Evaluation in
  the PCL small group setting.
• 4. Conduct pilot studies for changes in the PCL
  small group process to increase discussion in
  groups.

19
Goals for 2008-09

• 5. Introduce Team STEPPS skills into the
  Interprofessional Healthcare Course.
• 6. Improve faculty development processes.
  Develop handbook for facilitators to improve
  facilitator skills.
• 7. Replace current PDA program (CliniEX) for Year
  2 students with EValue software.
• 8. Make transition from four Basic Science Block
  Directors each year to a single Basic Science
  Director for each year.
• 9. Examine use of resources used by students in
  medical curriculum to determine if textbooks are
  still being used extensively.