Essay Assessment

1
Unit 5
Chapter 6
Essay Assessment
2
OVERVIEW
1. Essays, like other forms of assessment, must
be aligned with assessment targets. 2. Essays
can be developed in three steps Assessment
planning Exercise development Scoring
preparation 3. Careful planning can eliminate
most sources of bias. 4. Student involvement in
essay development can lead to successful and
enthusiastic learning.
3
Major Strengths of Essay Assessments
Essays can delve into students attainment of
complex and sophisticated achievement targets
such as their understanding of connections among
elements of knowledge. Essays can assess these
outcomes at a relatively low cost in terms of
teacher time and energy. Essay assessment can be
integrated productively into teaching and
learning especially through student involvement.
Stiggins, p. 156
4
Example
I think you will enjoy this example. In my
nutrition class, I explain the various components
of resting metabolic rate. Variables that impact
metabolic include the following Genetics Body
weight Age Gender Body composition In class
each student completes a worksheet that allows
him or her to estimate metabolic rate based on
body weight and gender. I explain that age isnt
included because there is only a 2 change per
decade after the age of 30 so its not really an
issue for the typical college-aged student.
5
The essay question that assesses their
understanding of resting metabolic rate goes like
this Assume we both have a normal metabolic
rate based on our gene pool. List each of the
other variables that effect resting metabolic
rate. For each variable, compare your metabolic
rate with mine (higher, lower, about the same),
and provide a rationale for your response.
Finally, based on that information, determine if
your overall metabolic rate is higher, lower, or
about the same as mine. (5 points)
6
Scoring 1 point for each variable and final
answer answer and rationale must both be correct
to receive a point Age they are 20 something
and I am clearly older. Gender men have a 5
edge. Weight am I larger, smaller, or about the
same (OK, I admit it, this one makes me a little
nervous - I never tell them my weight, specific
details arent the issue here) Body
composition this is the only variable that isnt
observable, but throughout the course I share
anecdotes so students are aware that I jog 4
miles every day and walk to work all year long.
They can compare their activity level to mine to
estimate body composition differences.
7
Typically, responses to this question show a
strong bias towards ageism. Even when a student
indicates that my activity level is greater than
hers and our weight is about the same, she still
assumes that her metabolic rate is greater than
mine because shes younger. When I return the
tests, I spend a little extra time on this
question. I assure them that I am not that much
older. Remember, there is only a 2 decrease per
decade after 30, and I am not that many decades
past 30! In any case, it is a teachable moment.
For those who fell into the ageism trap, I help
them put age into the context of the other
variables.
8
I could assess resting metabolic rate using
selected response questions. However, by using an
essay question, I can get at students
understanding of the complex relationships among
the variables that determine resting metabolic
rate.
9
Designing and developing essay assessments
involves 3 steps 1. Assessment planning 2.
Exercise development 3. Scoring preparation
10
Assessment planning
Create a table of test specifications or a list
of instructional objectives. This is the same
process as planning for selected response
assessment.
11
Exercise Development

• A good essay question will challenge students to
  describe a single and novel task. It will do
  three things
• Specify the knowledge students are supposed to
  know.
• Specify the kinds of reasoning or problem solving
  students are supposed to carry out.
• Point the direction to an appropriate response
  without giving away the answer.

12
Two options checklist and rating scale
Scoring Preparation
Checklist award points when specific
ingredients appear in the students
answers. Rating scale define achievement in
terms of one or more performance criteria for
example, you could use a five point rating scale
with criteria carefully identified for each
level. The rating can be done with a holistic
scale one that captures the overall evaluation
or you can use multiple analytical scales for
example, you could have a scale for each of the
following factors content mastery organization
of ideas
13
Student involvement in assessment has been a
focus throughout this course. Review Figure 6.6
in the textbook (p. 178). Will any of these
ideas work in your classroom? Are you willing to
try one? Or two? The strategies listed in
Figure 6.6 connect assessment to teaching and
learning in ways that can maximize both students
motivation to learn and their actual achievement.
Stiggins, p. 178-179
14
The key to success in essay assessment is
adherence to specific development procedures
1. Assessment planning 2. Exercise development 3.
Scoring preparation
SUMMARY
Bias problems can be avoided by carefully
connecting essay assessments to appropriate
achievement targets.