Assessment Overview Drake CPHS

1
Assessment OverviewDrake CPHS
2
Overview

• Overview of IDEA Data
• Assessing college-wide teaching goal
• Advising Results
• QA

3
Drake Background

• IDEA System
• Course evaluation system Heavily researched
• Used by 7 SOP/COP 320 institutions
• Measures progress against faculty objectives
• IDEA at Drake
• Since 2004
• Paper and on-line (35-45 courses/semester)

4
IDEA Background

• Students' feedback on their own learning
  progress, effort, and motivation,
• Student perceptions of the instructor's use
  of teaching methods and strategies.
• Rather than teaching style or personality, IDEA
  focuses on student learning and the methods used
  to facilitate it.

5
Progress on Relevant Objectives vs. IDEA National
Database
Converted Scores 2011-12 2010-11 2009-10 2008-09 2007-08
Much Higher (10 of courses) 8.2 5.5 1.6 1.4 1.1
Higher (20 of courses) 34.3 34.2 26.6 18.3 24.2
Similar (40 of courses) 43.8 42.5 43.8 57.8 50.6
Lower (20 of courses) 5.5 12.3 15.6 15.5 15.4
Much Lower (10 of courses) 8.2 5.5 12.5 7.0 8.8
Goal Progress 86.3 ? 82.2 ? 72 77.5 75.9
6
Actions

• What actions have been taken?
• Faculty Development meetings on
• Soul searching on what Im trying to achieve
• How to choose objectives (right ones, right
  number)
• Should Teaching methods be adjusted?
• Linking content and methods to the objective
• More use of IDEA resources (POD notes, etc.)
• Tie action to faculty annual goals
• Initiate FIFs early in semester
• Good discussions and culture of assessment

7
Primary Instructional Approach (11-12)
8
Instructor Related Course Requirements (Some or
Much required)
9
Percent of CPHS classes selecting objective as
either Essential or Important (FIF)
10
Student ratings of progress on objectives chosen
as Essential or Important
1no progress 2slight progress 3moderate
progress 4substantial progress 5exceptional
progress
11
Amount and Difficulty of Course work Student
Ratings
AY 2007-2008 AY 2008-2009 AY 2009-2010 AY 2010-2011 AY 2011-2012 AY 2007-2008 AY 2008-2009 AY 2009-2010 AY 2010-2011 AY 2011-2012 Average of classes below 3.0 of classes 4.0 or above
Amount of Reading CPHS 2.8 3.0 3.0 3.1 3.0 52 41 46 42 46 8 16 22 23 19
Amount of Reading IDEA 3.2 33 15
Amount of work in other (non-reading) assignments CPHS 3.4 3.3 3.2 3.3 3.2 34 32 39 28 42 28 20 8 13 11
Amount of work in other (non-reading) assignments IDEA 3.4 21 18
Difficulty of subject matter CPHS 3.4 3.4 3.3 3.4 3.3 36 33 35 29 35 33 31 26 28 25
Difficulty of subject matter IDEA 3.4 20 18
Values are similar if within 0.3 1Much less than
most courses, 2less than most, 3about average,
4more than most, 5much more
12
2012

• Trends towards more on-line evaluations
• Average response rate was down to 62 (57 online
  rate)
• Average Class size was 77
• Average number of objectives by faculty 3.7

13
Advising Interactions with Advisorover the
last AY
Meetings Emails Phone calls Other Total
HSCI (n72) 3.1 6.9 0.3 0.1 10.4
Pre-Pharm (n159) 2.4 5.0 0.2 0.1 7.7
Pharmacy (n249) 1.6 3.2 0.1 1.0 5.9
Total 2.1 4.3 0.2 0.6 7.1
Significantly different between all majors at
0.05
14
Advising Lowest agreement
HSCI Pre-Pharm Pharmacy Total
knows where to refer me for campus-wide support services (writing center, supplemental instruction, counseling center, disability resource center, academic achievement office). 63 70 55 61
has discussed professional involvement with me. 51 84 69 71
knows where to refer me for College support services (Student Services, Admissions, Professional and Career Development, etc.) 74 82 71 75
has helped me assess my career goals. 69 84 70 75
is knowledgeable about the campus general education program (Drake Curriculum). 72 84 71 75
15
Advising Highest agreement
HSCI Pre-Pharm Pharmacy Total
treats me as an individual. 85 96 94 93
is available for appointments. 87 96 90 92
encourages me to make my own decisions. 83 93 91 90
is willing to spend sufficient time with me to deal with my questions and concerns. 82 95 88 89
knows where to refer me for information on college policies and programs. 81 92 83 86
16
General Advising Effectiveness
HSCI Pre-Pharm Pharmacy Total
I am pleased with the overall nature of my meetings with my faculty advisor. 69 88 80 81
Overall, I have a good faculty advisor. 69 90 82 83
17
Future/ongoing areas

• Identifying embedded assessments
• Re-evaluate our educational outcomes?
• Populate new AAMS system (AACPs Assessment and
  Accreditation Management System)
• Re-write (condense) our Assessment Plan
• HSCI Program Review
• PharmD Accreditation (2014-2015)

18
Questions/Discussion