Assessment and Institutional Research

1
Assessment and Institutional Research

• March 28, 2006

2
Part I
3
Assessment Day Survey

• Gathers data from students to identify aspects of
  the student experience inside and outside the
  classroom with good practices

4
(No Transcript)
5
(No Transcript)
6
(No Transcript)
7
(No Transcript)
8
NSSE (Sp. 2004) vs. WSU (Sp. 2005)

• Academic, intellectual, and social experiences
• Mental activities (e.g. knowledge, comprehension,
  application, analysis)
• Challenge of examinations
• Quality of advising
• Time usage (e.g. preparation for class, career,
  co-curricular activities)
• Educational and personal growth
• Opinions about your school institutional
  emphasis, satisfaction

• NSSE National Survey of Student Engagement
  (College Student Report)
• Participating Institutions 557
  Universities/Colleges

9
Example
10
Part II

• CLA
• Peer group
• ACT composite score comparison data
• Student survey Admitted but not enrolled
• NEF comparison data
• High school student projection
• Graduate employment information
• Gap analysis (Job seeker shortage/surplus)
• Examples of Department request

11
Collegiate Learning Assessment

• 2005-2006

12
Purpose of the CLA

• Assessment of student learning
• Critical thinking
• Analytic reasoning
• Problem solving
• Written communication
• Institution as the primary unit of analysis
  (rather than individual student)

13
The CLA Tests and Scores

• Performance Task (PT)
• Critical thinking
• Analytical reasoning
• Problem solving
• Written communication skills
• Analytic Writing Task (AWT)
• Make an argument
• Critique an argument

14
Example of PT
15
Example of AWT

• Make an argument
• Critique an argument

16
Scores

• ACT scores (converted as SAT scores)
• A single score on a CLA task
• Analytic writing by E-Rater
• Performance task by a team of professional
  graders

17
WSU
Number of Freshmen with CLA and SAT scores
18
Relationship between mean SAT scores and mean
total CLA scores for Freshmen at WSU and other
institutions
19
Mean scores for freshmen at all schools and WSU
20
Spring 2006

• Assessment Day
• 111 Seniors
• 56 Performance Task
• 55 Analytic Writing Task
• Sampling approach
• Population criteria (student who has)
• 89
• Transfer credits
• Has a ACT score
• Stratified random sampling approach from the
  population based on the population criteria

21
Peer Groups(Initial stage)

• Inform our administration on how we compare and
  contrast among our competition and national peers

22
How were the peer groups selected?

• Regional peer group
• Data from the ACT yield analysis reports
• The report lists the number of ACT scores sent to
  both Winona State University and other
  universities. The regional peer group identified
  are the top five universities which students sent
  their ACT scores to, in addition to Winona State.
  
• National peer group
• Identified using the IPEDS executive peer tool
  and peer analysis system
• Ability of students- composite ACT scores
• Academic portfolio- programs, undergraduate and
  graduate headcount
• State appropriations- percent of state
  appropriations (State appropriations is then
  divided by the Full-time equivalent enrollment)
• Financial aid-percent of students receiving loans.

• IPED
• -Integrated Postsecondary Education Data System
• -Collect institution-level data (enrollments,
  program completions, graduation

23
Regional peer group

• Minnesota State University-Mankato
• University of Minnesota-Duluth
• University of Wisconsin-Eau Claire
• University of Wisconsin-La Crosse
• University of Wisconsin-River Falls

24
National peer group

• Southern Oregon University
• University of Central Arkansas
• University of North Carolina-Wilmington
• University of Wisconsin-Stevens Point

25
Regional peers
26
(No Transcript)
27
2002-03 Laptop fee was not included
28
National peer group
29
(No Transcript)
30
(No Transcript)
31
(No Transcript)
32
Highlights-example

• The tuition and fee difference for FY 03 WSU are
  9 higher than RPG
• The tuition and fee difference for FY 05 WSU are
  23 higher than RPG
• WSU NEF 1st retention rate (73) are 5 less than
  RPG (78) and 1 less than NPG(74)
• WSU 6-year graduation rates (52) are 5 less
  than RPG (57) and 4 higher than NPG

33
ACT
34
Regional Peer Group
35
Regional National Peer Group
36
Minnesota State University
37
Student Survey

• Admitted to WSU but Did not Enroll
• Fall 2005 (Requested by Admissions)

38
Purpose and Methods

• To provide WSU with demographic information and
  perception about students who were admitted to
  WSU but not enrolled.
• Mail survey
• Volunteer basis (n270)

39
Average ACT Score
24.24
23.49
23.48
23.35
23.1
40
Where do they current attend?
National Student Clearinghouse (NCHS) Provide
student records data
41
General information

• Scholarship
• Number of application
• Number of acceptance
• First years educational expenses resources
• Parents total income in 2005
• Reasons for choosing to attend the current school

42
Admitted but not enrolled students vs. Enrolled
students(Fall 2002-2005)

• NEF comparison data

43
Enrollment Decision
44
NEF Average ACT
45
NEF Average High School Percentile Rank
46
High School Student Projection
47
High School Student Population -11th and 12th
grade (2005-2006)
48
Graduate Employment Information

• (July 1, 2003-Jun 30, 2004)

49
Job Placement
- Mayo Nursing, Accounting, Computer Science -
Rochester School District Education - Target
Marketing, Human Resource Management, Business
Administration, Communication, Management
Information Systems - St. Paul School District
Education - Wells Fargo Business
Administration - Byron Public Schools Education,
Counseling Education
Source Career services
50
Gap Analysis
51
Nursing-Registered Nurse Jobseeker shortage
Statewide
52
Nursing-Registered Nurse Jobseeker shortage
Southeast Region
53
Total Program Planning Gap (2004 Q2)
54
Top 10 fields with program planning statewide
shortage

• Nursing
• Licensed practical nurse training
• Health aides/attendants
• Cosmetologist and related personal grooming
  services
• Food service mgmt
• Finance and financial management services
• Mental and social health services
• Rehabilitation and therapeutic professions
• Applied horticulture/horticultural operations
• Behavioral sciences

55
Top 8 fields with program planning Southeast
Region shortage

• Nursing-registered nurse
• Licensed practical nurse training
• Food service, waiter, waitress, bartending
• Health aides/attendants
• Dental support service technicians
• Medium/heavy vehicle truck technician
• Computer and information technology
• Culinary arts and related services

56
Department Request

• Examples

57
Math/Statistics

• Requested by Math/Statistics Dept.

58
Basic Skills Mathematics Courses

• General demographic information
• Placement exam scores
• Grade distributions for each basic skills
  mathematic course
• CAAPS exam results

59
AIR HOME PAGE

• http//www.winona.edu/air/IR/
• AIR/IR Home
• Fact Book
• Enrollment Data
• Program Review
• Student Profile (NEF/Transfer)
• Information Request (https//assessment.winona.edu
  /atk/instRes/dataRequestForm.htm)
• Assessment Tool (https//assessment.winona.edu/atk
  /login.jsp)