Developing Evaluation Rubrics

1
Developing EvaluationRubrics

• Cynthia Conn, Ph.D. Associate Director, Office of
  Academic Assessment and Clinical Instructor,
  Educational Technology Program
• Paula Garcia, Assessment Specialist, E-Learning
  Center

2
Agenda

• Description of rubrics
• Step-by-step guide for rubric development
• Resources
• Hands on rubric creation

3
Rubrics

• Definition At its most basic, a rubric is a
  scoring tool that lays out the specific
  expectations for an assignment. Rubrics divide
  an assignment into its component parts and
  provide a detailed description of what
  constitutes acceptable or unacceptable levels of
  performance for each of those parts. (Stevens
  and Levi 20053)

4
Rubrics

• Benefits
• Improve students end products increase
  learning
• Assists with clearly communicating assignment
  expectations
• Once a quality rubric is created it can be
  adapted to new situations or assignments

5
Developing Rubrics

• Step 1 Determine the concepts to be taught. What
  are the essential learning objectives?
• Usually these are found is your assignment
  description and/or listed in the objectives of
  your course.

6
Developing Rubrics

• Step 2 Choose the criteria to be evaluated. Name
  the evidence to be produced.
• Describe the best work you could expect
• Describe the worst acceptable work you might
  expect
• Develop intermediate-level descriptions
• Hint These criteria can be developed based on
  past student work on similar projects,
  observation of presentations, interviews with
  students, tutors, TAs, or in cooperation with
  instructors of similar courses.

7
Developing Rubrics

• Step 3 Develop a grid. Plug in the concepts and
  criteria.
• An alternative is for students to help generate
  the rubric criteria.
• A second alternative is to adapt an existing
  rubric to the specified assignment (resource
  http//rubistar.4teachers.org/index.php)

8
Example

• Original Rubric, Participation Rubric for Unit
  Development created by Dr. Barbara Frandsen at
  St. Edward's University,
• http//www.stedwards.edu/cte/resources/grub.htm
• Adapted Participation Rubric created for group
  project in ETC 545 Internet for Educators
• http//www4.nau.edu/assessment/oaainfo/workshop/Ru
  brics/Group_Participation_Rubric.htm

9
Developing Rubrics

• Step 4 Pilot the Rubric. Apply the rubric to a
  sample of student work, or ask a colleague to
  review for revision and clarification purposes.
• Step 5 Distribute the rubric to students before
  they begin the assignment.

10
Developing Rubrics

• Step 6 Evaluate the end product. Compare
  individual students' work with the rubric to
  determine level of achievement.
• Step 7 Revise and review the rubric based on the
  results of use.
• Initial Rubric http//www4.nau.edu/assessment/oaa
  info/workshop/Rubrics/InitialCurriculumWebScoringR
  ubric.pdf
• Revised Rubric http//www4.nau.edu/assessment/oaa
  info/workshop/Rubrics/ETC545CurriculumWebProjectRu
  bric.htm

11
Student Generated Rubrics

• Why?
• to improve the students motivation, interest,
  and performance in the project through increased
  participation and control.
• How?
• Begin with the outline grid and learning concepts
  (left column).
• Explain rubrics purpose to students and then
  brainstorm criteria to complete the grid.

12
Rubrics and Program Assessment

• Aggregate individual results for overall course
  and program assessment
• Database Individual reports and summary data
  reports for students and course and program
  assessment

13
Future Initiatives

• Rubric Banks
• ENG 105 Rubric (pilot version)
  http//dana.ucc.nau.edu/shd2/eng 105.htm
• Liberal Studies is in the process of developing
  skill specific rubrics (i.e., for writing, oral
  communication, and reading)
• Program/Department Level Rubric Bank

14
Online Rubric Banks

• University of Wisconsin, School of Education
  Professional Development Rubric Bank
• http//www.uwstout.edu/soe/profdev/rubrics.shtml
• A listing and links to Seven-categories (many of
  the categories with 10-12 rubrics each) of
  rubrics. Some of the rubrics are not
  specifically designed for higher education.
• Collaboration Rubrics
• http//edweb.sdsu.edu/triton/tidepoolunit/Rubrics/
  collrubric.html
• http//www.sdcoe.k12.ca.us/score/actbank/collaboru
  b.html
• University of Dallas Dallas Area Network for
  Teaching and Education Rubric Bank
• http//dante.udallas.edu/edu5352/rubrics.htm
• Shrocks Rubric Bank
• http//school.discovery.com/schrockguide/assess.ht
  mlweb

15
Developing A Rubric Online Resources

• Create Your Own Rubrics Online Online Teacher
  Rubric Resources
• http//www.kenton.k12.ky.us/tr/rubrics.html
• This page has excellent links to many different
  rubric generators.
• Electronic Rubric Tools
• RubiStar
• http//rubistar.4teachers.org/index.php
• An online tool to help the teacher who wants to
  use rubrics but does not have the time to develop
  them from scratch. Start with the tutorial (it
  includes information on changing categories,
  their headings and content). Register (free) with
  them so that you can save edit what you
  create. (Heidi Goodrich Andrade, Ohio
  University)
• Rubric Builder (Free trial download for 30 days)
• http//www.rubricbuilder.on.ca/
• Rubrics Generator (free)
• http//www.teach-nology.com/web_tools/rubrics/
• Rubricator (49.95)
• http//www.rubrics.com
• Rubric Construction Set (free)
• http//landmark-project.com/classweb/tools/rubric_
  builder.php3

16
Sources

• Maki, Peggy L. 2004. Assessing for Learning
  Building a Sustainable Commitment Across the
  Institution. Virginia Stylus Publishing, LLC.
• Allen, Mary J. 2004. Assessing Academic Programs
  in Higher Education. Massachusetts Anker
  Publishing Co. Inc.
• Stevens, Dannelle D. and Antonia J. Levi.
  Introduction to Rubrics As Assessment Tool to
  Save Grading Time, Convey Effective Feedback and
  Promote Student Learning. 2005. Virginia Stylus
  Publishing LLC.
• Creating Rubrics Inspire your students and
  foster critical thinking. 2000-2005. Pearson
  Education, Inc. http//www.teachervision.fen.com/p
  age/4521.html