Initial Results from the ROAD (Repository Of Assessment Documents)

1
Initial Results from the ROAD(Repository Of
Assessment Documents)
2
Step 1 Student Submits File to ROAD
Each student will upload two writing samples one
from ENGL 1551 and one from an upper-division
course in their major
3
Step 2 Random Sample Selected
4
Step 3 Reviewers Score Using Rubric
5
Student Characteristics
All Students in ENGL Sample 1551,
Spring 2011 Characteristic N Mean
Mean Age 193 22.3 22.8 High School GPA
165 3.36 3.10 YSU GPA 193 3.16
2.79 Hours Completed 193 43.2 41.1 ACT
English Score 157 21.9 21.1 After completion
of Spring, 2011
6
Student Characteristics, cont.
All Students in ENGL Sample 1551, Spring
2011 Ethnicity Freq. Asian 5 2.6 1.3 Black 1
8 9.3 12.4 Hispanic 4 2.1 2.1 White 157 81 78.9 O
ther 0 0 0.9 Unknown 9 4.7 4.4
7
Student Characteristics, cont.
All Students in ENGL Sample 1551, Spring
2011 Gender Freq. Female 110 57 54 Male 83
43 46
8
Items with Highest Rubric Scores
Context and Purpose (Item 1) Mean 1.90
Syntax and Mechanics (Item 5) Mean 2.03
9
Items with Lowest Rubric Scores
Writing Conventions (Item 3) Mean 1.62
Students Position (Item 6) Mean 1.68
10
Scores and Student Characteristics

• For each of the seven rubric items logistic
  regression analysis was conducted to see if there
  was a relationship between the rubric score and
• Age
• Gender
• Ethnicity (white/nonwhite)
• ACT English Score

11
Scores and Student Characteristics, cont.

• Age
• No relationship for 5 of the 7 items (The
  exceptions were Sources and Evidence, item 4,
  and Conclusion, item 7. Younger students had
  higher scores.)
• White/Nonwhite
• No relationship for any of the 7 items

12
Scores and Student Characteristics, cont.

• Gender
• No relationship for 6 of the 7 items (The
  exception was Conclusions, item 7. Men had
  higher scores.)
• English ACT Score
• Positive relationship for 6 of the 7 items (The
  exception was Writing Conventions, item 3.)

13
Scores and Student Characteristics, cont.
English ACT and Sources and Evidence (Item 4)
14
Scores and Course Grades
All Students in ENGL Sample 1551, Spring
2011 Grade Freq. A 107 57.5
44.2 B 49 26.3 28.1 C 15 8.1
11.7 CR 2 1.1 7.9 NC 13 7.0 15.2
15
Scores and Course Grades, cont.

• Rank (Spearman) Correlation Results
• No evidence of a relationship between the rubric
  scores and the final grade in the course with two
  exceptions
• Sources and Evidence
• (item 4, 0.1 significance level)
• Conclusions
• (item 7, 0.1 significance level)

16
Shameless Advertisements
The YSU Writing Center launched a new online
scheduling system at ysu.mywconline.com. The new
site allows students to upload files and offers a
better platform for synchronous online
consultations to better meet the needs of
distance education. The General Education
website has been updated to include the new
general education model. Please visit the site
at http//web.ysu.edu/ger/
17
Acknowledgements
Initial Planning Donna Wainio Kevin Ball Gary Salvner Sharon Stringer Angela Messenger 2010-11 General Education Committee Computer Services Robert Forchione Salem Alemaishat Rubric Committee W. Gregg Sturrus Patricia Sarro Tammy King Angela Messenger Alan Tomhave Gail Saunders Smith Writing Center Angela Messenger Funding Provost Ikram Khawaja