Administering the English Language Proficiency Assessment ELPA

1
Administering the English Language Proficiency
Assessment (ELPA)

• Spring 2007 Administration
• Teleconference at Wayne RESA
• February 15, 2007

2
Part 1 Welcome and Introduction

• Marilyn Roberts
• Director
• Office of Educational Assessment and
  Accountability (OEAA)
• Phil Chase
• ELL Assessment Specialist
• Office of Educational Assessment and
  Accountability (OEAA)

3
Part 1 Welcome and Introduction

• Questions?
• E-mail answers_at_resa.net
• Fax [phone]

4
Part 1 Welcome and Introduction

• To download todays Power Point,
• go to www.mistreamnet.com

5
Part 1 Welcome and Introduction

• To order videotapes or DVDs
• contact Brenda Hose
• E-mail hoseb_at_resa.net
• Phone [phone]

6
Part 1 Welcome and Introduction

• Meeting Federal Requirements
• Features of the Spring 2007 ELPA
• Planning for the Assessment
• Assessment Materials

7
Part 1 Welcome and Introduction

• Scoring Speaking Items
• After The Assessment Ends
• Packaging and Returning Materials
• Spring 2007 ELPA Dates

8
Part 1 Welcome and Introduction

• Who takes the ELPA?
• All K-12 students who are eligible to receive
  English Language Learner (ELL) services.
• A student who is an ELL is also known as Limited
  English Proficient in some states and laws.
• All public and charter schools are included,
  along with private schools (depending on LEA
  agreements).

9
Part 1 Welcome and Introduction

• How is eligibility determined?
• A Home Language Survey is provided to all new
  students enrolling in school. This is a Title VI
  requirement.

10
Part 1 Welcome and Introduction

• What are the Home Language Survey questions?
• Is your childs native tongue a language other
  than English?
• Is the primary language used in your childs home
  or environment a language other than English?

11
Part 1 Welcome and Introduction

• If the answer to either question on the Home
  Language Survey is YES, the student is
  considered eligible to be assessed.

12
Part 1 Welcome and Introduction

• What is the purpose of ELPA?
• ELPA is used to determineon an annual basisthe
  progress that students who are eligible for
  English Language Learner (ELL) services are
  making in the acquisition of English language
  skills.

13
Part 1 Welcome and Introduction

• What is the purpose of ELPA?
• ELPA creates a more uniform measure that helps
  ELLs to participate and succeed in academic
  courses.

14
Part 1 Welcome and Introduction

• How are ELPA results to be used?
• ELPA is used for the Annual Title III Reporting
  and showing progress on the attainment of ELP
  standards.
• Reporting must include at least 3 levels of
  performance Basic, Intermediate, and Proficient.

15
Part 1 Welcome and Introduction

• Spring 2007 is the second annual administration
  of the ELPA.
• For all students who are eligible for ELL
  services in grades K 12
• Assesses academic and social language

16
Part 2 Assessment Features

• Phil Chase
• ELL Assessment Specialist
• Office of Educational Assessment and
  Accountability (OEAA)

17
Part 2 Assessment Features

• Levels of Assessment
• Domain Sections
• Whats New From Spring 2006

18
Part 2 Assessment Features

• Five Levels of Assessment
• Level IKindergarten
• Level IIGrades 1-2
• Level IIIGrades 3-5
• Level IVGrades 6-8
• Level VGrades 9-12

19
Part 2 Assessment Features

• Four Language Domains
• Listening
• Reading
• Writing
• Speaking
• Note A 5th domain, Comprehension, is reported
  to meet Title III requirements. Its score is
  taken from a composite of Listening and Reading
  standards.

20
Part 2 Assessment Features

• Listening, Reading, Writing domains assessed as
  individual sections
• Untimed
• Group-administered
• Can be done in separate, continuous sessions

21
Part 2 Assessment Features

• Listening Section Features
• Variety of discourse styles (passage length and
  difficulty level)
• Both academic and social contexts
• CD or audiocassette has directions passages,
  prompts, items, and item choices

22
Part 2 Assessment Features

• Reading Section Features
• Passage styles
• Literary/Narrative
• Informational/Content-based
• Modes of comprehension assessed
• Literal
• Inferential
• Vocabulary, multiple meanings, and idioms

23
Part 2 Assessment Features

• Writing Section Features
• Item formats
• Writing Conventions multiple-choice items
• Writing performance-based, short answer items
  and prompts for extended writing

24
Part 2 Assessment Features

• Speaking domain assessed as an individual section
• Untimed
• Individually-administered
• Completed in one session

25
Part 2 Assessment Features

• Speaking Section Features
• Five separate speaking activities
• Student responses scored at time of
  administration using a scoring form and rubrics

26
Part 2 Assessment Features

• Number of Points per Level

27
Part 2 Assessment Features

• Item Formats for Domains

28
Part 2 Assessment Features

• Whats New For 2007?
• Kindergarten as a separate assessment level
• Updated item formats and rubrics for Speaking
• Updated rubrics for Writing (scored by Harcourt)

29
Questions so far?

• Questions?
• E-mail answers_at_resa.net
• Fax [phone]

30
Part 3 Planning for the Assessment

• Marilyn Roberts
• Director
• Office of Educational Assessment and
  Accountability (OEAA)
• Phil Chase
• ELL Assessment Specialist
• Office of Educational Assessment and
  Accountability (OEAA)

31
Part 3 Planning for the Assessment

• Assessment Accommodations
• Registering New Students
• Security

32
Part 3 Planning for the Assessment

• How are ELPA accommodation decisions made?
• Use of an accommodation is based on documentation
  in school record.
• Decisions are to be made on student-by-student
  basis.

33
Part 3 Planning for the Assessment

• What ELPA accommodations are considered
  nonstandard?
• Nonstandard accommodations change construct being
  measured.
• Students using nonstandard accommodations will
  not count as being assessed for participation
  rates.

34
Part 3 Planning for the Assessment

• Where can ELPA Accommodations be located?
• Refer to Assessment Accommodations Summary Table
  in Appendix A of the Directions for
  Administration for ELPA specifics.
• Also located on the www.michigan.gov Web site

35
Part 3 Planning for the Assessment

• Registering New Students
• Click on the NEW Student Button.

36
Part 3 Planning for the Assessment

• Registering New Students (cont.)
• Fill out all RED Required fields and any optional
  fields desired then click Save

37
Part 3 Planning for the Assessment

• Registering New Students (cont.)
• Add student to the appropriate test cycle and
  ensure the correct subjects are checked
• Always verify pre-ID by using the Pre-Identified
  Student report

38
Part 3 Planning for the Assessment

• Barcode Labels
• You should print barcode labels for all students
  that did not come pre-identified.
• Click Barcode Labelsfrom the menu on theleft on
  the web page.

39
Part 3 Planning for the Assessment
You should then see this
To generate a list of all the students assigned
to the given test cycle, select from the drop
down menus the ISD, District, School, Grade and
Test cycle. Then click the Search button.
40
Part 3 Planning for the Assessment
You may use the Select All button to select all
of the students listed. When you have selected
the students and are ready to print, click the
Submit button.
41
Part 3 Planning for the Assessment
Adobe Acrobat will open a new window and display
an image of your labels.
42
Part 3 Planning for the Assessment
If everything looks correct, click on the printer
icon, which normally is located near the top left
corner of the window.
43
Part 3 Planning for the Assessment
On the Printer Dialog window that appears next,
ensure the shrink oversized pages or fit to page
(depending on your version of Adobe) option is
NOT checked. If you have an auto-rotate and
center pages option, please make sure that is
checked.
Click on OK to print.
44
Part 3 Planning for the Assessment
The label should be attached to the bottom right
corner of the ELPA Demographic Form.
45
Part 3 Planning for the Assessment

• Additional Assessment materials
• If additional materials are needed, contact your
  ELPA Building Coordinator.
• Specify the type and amount of materials.

46
Part 3 Planning for the Assessment

• Security Procedures
• Assessment materials must be carefully monitored.
• ELPA test booklets and answer documents may not
  be photocopied.

47
Part 3 Planning for the Assessment

• Security Procedures (cont.)
• All materials must be kept in locked storage
  before and after each session.
• Only the students taking the ELPA may view their
  test booklets or answer documents.

48
Part 3 Planning for the Assessment

• Security Procedures (cont.)
• Please fill out and sign an original copy of the
  Security and Compliance Form for your role
  (Assessment Administrator or Assessment Proctor).

49
Part 3 Planning for the Assessment

• Before each session of the ELPA begins
• Ask students to put away all books, notes, and
  papers
• Make sure that students have the correct
  documents
• Make sure all students have a 2 pencil

50
Part 4 Assessment Materials

• Duane Manning
• Senior Program Director
• Harcourt Assessment, Inc. (HAI)
• Phil Chase
• ELL Assessment Specialist
• Office of Educational Assessment and
  Accountability (OEAA)

51
Part 4 Assessment Materials

• Levels I and IIgrades K, 1-2
• 1 Assessment Booklet per student (students record
  responses in booklet)
• 1 reusable Speaking Assessment Booklet per class
• 1 Directions for Administration (DfA) per teacher
• Optional CD or audiocassette

52
Part 4 Assessment Materials
53
Part 4 Assessment Materials

• Levels III, IV, and Vgrades 3-12
• 1 Assessment Booklet per student (includes all
  sections)
• 1 Answer Document per student
• 1 Directions for Administration (DfA) per teacher
• Optional CD or audiocassette

54
Part 3 Assessment Materials
55
Part 4 Assessment Materials

• Remember that the ELPA is untimed, so the
  following projected times are estimates that are
  given for planning purposes only.

56
Part 4 Assessment Materials
Grade K
57
Part 4 Assessment Materials
Grades 1-12
58
Part 4 Assessment Materials

• Schools may administer the ELPA sections in any
  sequence for ease of scheduling.
• Each section of the ELPA must be administered in
  one continuous session.

59
Part 4 Assessment Materials

• The Writing section has two separate parts and
  therefore may be split up between sessions.
• The Speaking section should be administered at a
  location separate from other students.

60
Part 4 Assessment Materials

• Special Note for Levels III, IV, and V
• These levels have three forms (numbered 1 through
  3).
• At each of these levels, the very first sample of
  the Listening section is different by form.
• On Form 1, the answer to Sample A of the
  Listening section is A.

61
Part 4 Assessment Materials

• Special Note for Levels III, IV, and V (cont.)
• On Form 2, the answer to Sample A of the
  Listening section is B.
• On Form 3, the answer to Sample A of the
  Listening section is C.
• Knowing this, you can avoid confusion and make
  sure that you are reading directions from the
  correct form.

62
Questions so far?

• Questions?
• E-mail answers_at_resa.net
• Fax [phone]

63
Part 5 Scoring Speaking Items

• Marilyn Roberts
• Director
• Office of Educational Assessment and
  Accountability (OEAA)
• Phil Chase
• ELL Assessment Specialist
• Office of Educational Assessment and
  Accountability (OEAA)

64
Part 5 Scoring Speaking Items

• At various levels
• Sentence Repeat
• Short Conversation
• Storytelling
• Story Retell
• Guided Discussion

65
Part 5 Scoring Speaking Items
Sentence Repeat

• Student hears and reads sentence before repeating
  it.
• New items feature updated rubric.
• One point maximum score.

66
Part 5 Scoring Speaking Items
Sentence Repeat

• Proctor listens for fluency and smoothness of
  speech, proper pronunciation, and appropriate
  intonation, which is consistent with
  comprehension of the main idea of the utterance.

67
Part 5 Scoring Speaking Items
Sentence Repeat Video Clip
68
Part 5 Scoring Speaking Items
Short Conversation

• Student hears and reads prompt and responds to
  question(s).
• Questions are as open-ended as possible but still
  guide student toward focused answer.

69
Part 5 Scoring Speaking Items
Short Conversation

• New items feature updated rubric.
• Two points maximum score.

70
Part 5 Scoring Speaking Items
Short Conversation

• Proctor listens for fluency and accuracy, with an
  emphasis on the students ability to use
  appropriate vocabulary to express personal
  opinions, ideas, or points of view.

71
Part 5 Scoring Speaking Items
Short Conversation Video Clip
72
Part 5 Scoring Speaking Items
Storytelling

• Student sees sequence of three graphics and
  creates oral story or narrative about pictures.
• Sequence of graphics is marked First, Next, and
  Last.

73
Part 5 Scoring Speaking Items
Storytelling

• Uses previous item format and rubric from 2006
  ELPA.
• Four points maximum score.

74
Part 5 Scoring Speaking Items
Storytelling

• Proctor listens for complex sentence structures,
  varied and precise vocabulary, and logical
  presentation of ideas with appropriate
  transitions.

75
Part 5 Scoring Speaking Items
Storytelling Video Clip
76
Part 5 Scoring Speaking Items
Story Retell

• Student hears and reads narrative or
  content-related text.
• Student responds by telling back to the proctor
  as much as possible, with allowance for added
  details.

77
Part 5 Scoring Speaking Items
Story Retell

• Student bases response on an age-appropriate
  passage.
• Updated rubric.
• Four points maximum score.

78
Part 5 Scoring Speaking Items
Story Retell

• Proctor listens for authentic speech patterns of
  student, including use of grammatical
  constructions, descriptive vocabulary, and
  transitional phrases to re-tell recognizable
  story with fluency of speech.

79
Part 5 Scoring Speaking Items
Story Retell Video Clip
80
Part 5 Scoring Speaking Items
Guided Discussion

• Item format is a two-part set of questions with
  short prompt to lead into discussion.
• Student hears and reads prompt and responds to
  first question.
• Student then hears and reads follow-up question
  and responds.

81
Part 5 Scoring Speaking Items
Guided Discussion

• New item format at all levels rubric aligned to
  standards.
• Two points maximum score for each prompt total
  four points maximum. Proctor scores each portion
  individually.

82
Part 5 Scoring Speaking Items
Guided Discussion

• Proctor listens for students conversational flow
  and exchange of information, with fluency and
  accuracy based on vocabulary.
• The proctor will then listen for the student to
  focus the discussion on specific details or
  examples after the second prompt.

83
Part 5 Scoring Speaking Items
Guided Discussion Video Clip
84
Part 5 Scoring Speaking Items

• One copy of the Michigan ELPA Speaking Scoring
  Training DVD will be made available to each ELPA
  district coordinator.

85
Part 6 After The Assessment

• Marilyn Roberts
• Director
• Office of Educational Assessment and
  Accountability (OEAA)

86
Part 6 After The Assessment

• Make sure there is one test booklet or answer
  document per student.
• Make sure that each test booklet or answer
  document has a pre-printed Harcourt label or a
  label printed at the school.

87
Part 6 After The Assessment

• Check test booklets or answer documents for
• Form number (Levels III-V only)
• Demographic form information
• Optional school fields and those marked School
  Use Only

88
Part 6 After The Assessment

• Tell your Building ELPA Coordinator if you have
  materials that require special handling (such as
  documents used for an accommodation).

89
Part 6 After The Assessment

• Return all assessment materials, both used and
  unused, to your Building ELPA Coordinator as soon
  as possible following the assessment.

90
Part 6 After The Assessment

• Complete the ELPA Security Compliance Form (using
  an original copy) and return it to your Building
  ELPA Coordinator.
• Assist your Building ELPA Coordinator in
  completing the School/Grade Header Sheet.

91
Part 7 Packaging and Returning Materials

• Duane Manning
• Senior Program Director
• Harcourt Assessment, Inc. (HAI)

92
Part 7 Packaging and Returning Materials

• Organization of Materials
• Separate scorable assessment booklets and answer
  documents by assessment level.
• Level I Grade K
• Level II Grades 1-2
• Level III Grades 3-5
• Level IV Grades 6-8
• Level V Grades 9-12

93
Part 7 Packaging and Returning Materials

• Organization of Materials (contd.)
• Documents from different grade levels within the
  same assessment level may be placed in any order
  and may be mixed.

94
Part 7 Packaging and Returning Materials

• Class/Group Organization
• If the report listing of students is by
  class/group, organize the materials into
  class/group stacks first, and then place them
  into assessment level stacks.
• Be sure to include an original Class/Group ID
  sheet with every class/group.
• Combine all assessment level stacks into one
  school stack.

95
Part 7 Packaging and Returning Materials

• Grade Level Organization
• If the report listing of students is by grade,
  organize the materials into assessment level
  stacks.
• Be sure to include an original School/Grade
  header sheet for each grade span submitted.

96
Part 7 Packaging and Returning Materials

• Returning Materials to your District
• Place scorable documents in the original boxes if
  possible. Use a sturdy carton or box if this is
  not possible.
• If you have non-scorable materials to return,
  place them at the bottom of the carton or box.
• Building ELPA Coordinators will return their
  materials to the District ELPA Coordinator.

97
Part 7 Packaging and Returning Materials

• Returning Materials to your District (contd.)

98
Part 7 Packaging and Returning Materials

• Returning Materials to Harcourt
• Districts must ship all materials back in one
  shipment to ensure timely processing.
• Districts use labels provided by Harcourt for
  shipping.
• The ELPA Manual will be available electronically
  on the OEAA Secure Web site, https//oeaa.state.mi
  .us/meap

99
Important Dates

• March 5Assessment Materials Due to Schools
• March 19 to April 27Spring 2007 ELPA testing
  window

100
Important Dates

• April 2 to May 4Districts return ELPA Materials
  for scoring.Posting of preliminary ELPA reports
  occurs 28 days after materials are received at
  Harcourt for scoring.

101
Contact Information

• OEAA Offices
• (877) 560-TEST (8378)
• oeaa_at_michigan.gov
• Harcourt Customer Support
• [phone]
• customersupportcenter_at_harcourt.com

102
Contact Information

• Marilyn Roberts
• Director, OEAA
• RobertsM_at_michigan.gov
• [phone]
• Phil Chase
• ELL Assessment Specialist, OEAA
• chasep2_at_michigan.gov
• [phone]

103
Contact Information

• ELPA Web Site
• http//www.michigan.gov/elpa
• OEAA Secure Site
• https//oeaa.state.mi.us/meap

104
Special Thanks!

• Wayne RESA
• Michigan ISDs
• MAISAs network of teleconference sites