Curriculum Evaluation for OtolaryngologyHead and Neck Surgery - PowerPoint PPT Presentation
1 / 18
Title:
Curriculum Evaluation for OtolaryngologyHead and Neck Surgery
Description:
Curriculum Evaluation for Otolaryngology-Head and Neck Surgery. Matthew Ryan, MD. Department of Otolaryngology. The University of Texas Medical Branch ... – PowerPoint PPT presentation
Number of Views:71
Avg rating:3.0/5.0
Title: Curriculum Evaluation for OtolaryngologyHead and Neck Surgery
1
Curriculum Evaluation for Otolaryngology-Head and
Neck Surgery
- Matthew Ryan, MD
- Department of Otolaryngology
- The University of Texas Medical Branch
2
What is a curriculum evaluation?
- The principal purpose of evaluation is to produce
information that can guide decisions concerning
the adoption or modification of an educational
program
3
Curriculum Development
4
Impetus for Evaluation
- New Chairman, Shawn Newlands MD, PhD, MBA
appointed in October 2003 - RRC site visit July 2004
- New ACGME requirements
5
The 6 ACGME Competencies
- Patient care
- Medical knowledge
- Practice based learning and improvement
- Interpersonal and communication skills
- Professionalism
- Systems-based practice
6
ACGME Outcomes Assessment Project
- 2001-2002 Define specific objectives for
learning the competencies and begin
integration into educational experiences - 2002-2006 Provide evidence of learning in all
6 competencies - 2006-2011 Provide evidence of learning and
assessment of all 6 competencies - Use assessments for program
improvement and link with educational outcomes
7
Paradigm shift in residency curriculum evaluation
What is Covered ?
What are residents able to do?
8
Stakes Models
Pre-Ordinate Evaluation
Responsive Evaluation
9
Methods of Review
- Benchmarks
- Criteria established by RRC
- Surveys of other program directors
- Experiences of faculty members
- Resources provided by ACGME
- -Assessment methods toolbox
10
Methods of Review
- Systematic collection of information
- Participant experiences explored
- Actual curriculum compared to intended
curriculum - Questionnaire for residents to evaluate aspects
of the whole educational experience
11
Qualitative Research
- Thematic Analysis
- Focuses on identifiable themes or patterns of
behavior - -collect data
- -identify patterns
- -identify data that relate to the patterns
- -combine and catalogue related patterns into
sub-themes - -formulate theme statements and develop a story
line
12
Qualitative Research
- Situational Analysis
- Identifies internal and external factors
affecting an organization
External Factors
Internal Factors
13
Methods of instruction
- General and rotation-specific objectives
- Modeling in clinical activities
- Research rotation
- Research conference
- Grand rounds, MM and research presentations
- Home study course
- Audiology practicum
- Bailey recitation conference
- Temporal bone lab
- Microvascular lab
- Surgical dissection lab
- Journal club
- Head and neck conference
- Rhinology conference
- Facial plastics conference
- Joint Plastics conference
- Pediatric conference
- Otology conference
- Laryngology conference
- Tumor conference
- Radiology conference
- 5th Monday conferences
- Basic introductory course
14
Methods of Evaluation
- BIC Exam
- Annual in-service exam
- Grand Rounds quizzes
- Radiology conference questions
- Rotation specific objectives oral exam
- Bimonthly faculty evaluations
- MM conference
- Research day evaluations
- Grand rounds presentation evaluations
- Home study course exams
- Risk management exam
- Semi annual evaluation by program director
- Annual evaluations by nursing staff and
audiologists - Faculty observation
- On-line case log
- External invited examiners (FAA model)
- Systems survivor assessment tools
- Final evaluation at end of residency
- Press-Ganey patient satisfaction surveys
- Resident on resident peer evaluation
15
Findings
- Didactic Program
- Conferences held during work day
- Conferences too frequent
- Poorly attended
- Many conferences of inadequate educational value
16
Curriculum Development
17
Changes
- Didactic Program
- Conferences held outside of clinical working
hours - Attendance mandatory for residents
- Specialty conferences held on a monthly basis
18
Most Pressing Needs
- Trainee Evaluation
- -Faculty development
- better formative feedback
- -Expand evaluation methods
- FAA model
- SPs-OSCE and Secret Shoppers
- Competency based and performance based
Recommended
CrystalGraphics Presentations
