Assessment for Learning

1
Assessment for Learning

• Introducing the OARS/INSPECT and SCANOARS tools
  for developing common Formative Assessments
• December 8, 2008

2
Todays Tasks

• Outline a context for Formative Assessment
• Touch briefly on a the history of OARS
• Learn how to Login to OARS System
• Learn how to Build A Quiz using INSPECT
• Learn how to download and Install SCANOARS
  software
• Demonstrate how to Scan an INSPECT Quiz
• Provide an introduction to OARS Reports
• Provide contacts to call for help

3
Context for Formative Assessment
4
Cycle of Teaching
Planning of Instruction
Planning of Instruction
Instructional Strategies
Reflection
Assessment
Analysis
5
Assessment and Learning

• Teaching, learning and assessment are all
  interrelated
• Using assessment can help promote a learning
  community
• Deeper understanding of standards and what they
  look like
• Discussions about assessments (developing,
  results, etc) can help define/refine teaching
• Shared understanding of the outcome and
  discussions about the best approaches for
  obtaining proficiency

6
Cycle of Teaching
7
A Brief History of OARS
8
OARS Online Assessment Reporting System

• History
• Originally set up to be used for Reading First
  schools (SCOE)
• Created by previous classroom teacher
• Has grown in use and capability
• Speaks to need for more frequent monitoring and
  increased capability of assessment use
• Purpose of adding OARS
• Access to INSPECT item bank
• Access to reporting features
• Some tests for purchase can be scanned in the
  OARS.SCOE, Theme Skills, INSPECT, etc.

9
Many assessments to look at

• Interim assessments
• SCOE
• Theme Skills
• INSPECT
• Etc.

10
Login to OARS
11
Login to OARSQuick Start Guide

• Navigate to http//www.oarsaccess.net/
• Select Fresno USD in the Select your District
  window
• Log in. Initial log ins are
• Username firstname.lastname, using the
  Sharepoint format
• 1st Password birth month and last 2 digits of
  birth year September 1963 would be 0963
• Usernames and passwords also handed out today
• This is NOT AiS!!!! The username and password
  for OARS is different than in AiS
• Problems with passwords? Call your schools OARS
  Liaison or Bon Vang in REA at 457-3895
• Three Download Resources may be helpful for
  you OARS in a Nutshell, OARS Users Manual,
  and ScanOARS Download (when you are ready for
  scanning)

12
Login to Oars Step by Step

1. Go to www.oarsaccess.net,
2. Choose Fresno USD and Click GO to login

13
Login to Oars Step by StepAllowing Popups
Some users may have to allow popups in order for
OARS to work properly. The following slides only
apply if you see either or both of the messages
seen here.
CLICK OK or Close as needed to clear the error
messages
If you see dont see either or both of the
messages above, SKIP to slide 16 of this guide.
14
Login to Oars Step by StepAllowing Popups
CLICK Tools ? Pop-up Blocker ? Always Allow
Pop-ups from This Site

• Notes
• The screen will blink and refresh itself when you
  do this.
• You will probably only need to do this once per
  computer.

15
Login to Oars Step by Step

1. Type in Username
2. Enter Password
3. CLICK Log In

16
Login to Oars Step by StepExtra Step First
Login Only
Read the Terms and Conditions, then CLICK I am
an Authorized User and I Accept All Terms and
Conditions Above
17
Login to Oars Step by StepFirst Time Login and
Password Changes
Complete the Password, Confirm Password, Security
Question, and Response
CLICK Update My Account
Note To change your password in the future,
you may access this screen by clicking on the MY
ACCOUNT tab found on the OARS main page.
18
Login to Oars Step by StepFirst Time Login and
Password Changes
Note Having changed your password, you will
receive a confirmation message. The click here is
a little hard to see so its highlighted here.
CLICK here
19
Login to Oars
You will find the Log Out in the upper right-hand
corner. (Not pictured).
20
Build A Quiz Using Inspect
21
Build a Quiz using Inspect Quick Start Guide

• To Build a Quiz .
• Select the INSPECT tab at the top of the main
  menu
• Select the Create a new test button
• NEW An Automatic Build Feature was reactivated
  Nov, 2008!
• Complete the Test Information boxes
• Select the Course, Strand and Standard
  Information
• Select items for the quiz by choosing the ADD
  button for each item you select. You can see the
  directions and the distractor rationales for an
  item by clicking the boxes below each item.
• Note for ELA items, there is an option to look
  at other items that use the same reading passage.
  If you are trying to create a one passage
  quiz, you might select this to identify other
  items associated with the passage.
• An Inspect quiz should be short 5-6 items only

22
Build a Quiz using Inspect Quick Start Guide -
Continued

• Review the draft of your quiz
• Save the quiz after you click on save, you can
  still edit/delete, until you ..
• Print and Lock (when you do this, a print copy
  will appear in a new window).
• You can also choose to share the quiz, or keep it
  just for your class
• Print the quiz, and you have several print
  options available for how youd like the quiz to
  look
• Bubbles or letters for the answer choices
• Answers highlighted or not
• Answer key accompanying
• Print a copy with distracter rationales

23
Build a Quiz using Inspect Quick Start Guide -
Continued

• To Print Answer Sheets .
• Teachers with multiple grade levels, or teaching
  multiple classes (secondary) will need to select
  a section of their classes for which to print
  answer sheets. Click on the Sections tab on
  the blue strip at the top of the screen, then
• Click on the program menu, and select Inspect
  Item Bank
• Click on your name
• If you are selecting a subset of all your
  students to take the test, select them here,
  otherwise the whole student list will be uploaded
  
• From the Inspect tab, select Print answer
  sheets and follow the directions there.
• Have students take the quiz!!

24
Build a Quiz using Inspect Step-By-Step
25
Build a Quiz using Inspect Step-By-Step
The Inspect Main Screen
STEP 2 Click on Create New Test here
26
Build a Quiz using Inspect Step-By-Step
If you are sharing quizzes, consider what your
descriptions will mean to other users. Also, what
will they mean to you in 10 months?
27
Build a Quiz using Inspect Step-By-Step
28
Build a Quiz using Inspect Step-By-Step
28
Add Checked Items
29
Build a Quiz using Inspect Alternatives When
Selecting Items
The correct answer is highlighted.
STEP 2 Click on Create New Test here
Some items (esp. ELA and History) are based on a
reading passage. This link can be used to find
those other items
You can click on the Show links to see
Instructions and/or Distractor Rationales
29
30
Build a Quiz using Inspect Step-By-Step
Need to go back?Follow the breadcrumb trail
31
Build a Quiz using Inspect Step-By-Step
32
STEP 11c (Optional) You can also choose the
checkboxes for each item and scroll to the bottom
of the screen to Remove Checked Items
Build a Quiz using Inspect Step-By-Step
STEP 11d (Optional) Or you can simply choose to
Remove All Items
33
Build a Quiz using Inspect Step-By-Step
34
Build A Quiz Using InspectAdditional Information

• Do not quarantine an item
• It might lock others out from using it
• Or, for some users, the only one locked out is
  that user
• Some items are quarantined at the system level
  for inclusion on a District-wide test (CAHSEE
  Diagnostic tests)
• Some questions have an extra version created
  (e.g., with just a small change to an answer
  choice). The View Alternate Item button allows
  you to see all versions of an item, and pick the
  one you want to use.
• You can now delete a quiz using Inspect test
  managementTechnically the quiz is still there,
  but if you use the delete option, you will never
  have to see it again!This can help keep your
  page of active quizzes well-organized.

35
Build a Quiz using Inspect Step-By-Step
You may still review and edit a quiz UNTIL you
Print and Lock it! Once its locked, you have
to start the process over!
STEP 13 Print and Lock your quiz here
STEP 14 Click OK
35
36
Build a Quiz using Inspect Step-By-Step
Once you are ready to print your answer booklet,
you will have several printing options.
37
Build a Quiz using Inspect Step-By-Step
STEP 15 Click on File then Print to produce the
document
Opening the print feature actually opens a new
window or tab (depending on your version of
Internet Explorer) You will need to close the
window or tab to return to the OARS.
38
Build a Quiz using Inspect Step-By-Step
38
39
Build a Quiz using Inspect Step-By-Step
STEP 17 Click on Sections to produce the Answer
Sheets
STEP 18 Select Inspect Item Bank
STEP 19 (SECONDARY ONLY) Select your class(es)
here
40
Build a Quiz using Inspect Step-By-Step
You will be given the choice of opening all of
the documents for immediate printing, or saving
the documents for printing later.
41
Build a Quiz using Inspect Step-By-Step
42
Download and Install SCANOARS Software
43
Download Install ScanOARS

• This may not be necessary at your school site. To
  find out whether or not you need to download and
  install the ScanOARS software, please contact the
  OARS-INSPECT liaison for your school.
• The following represent the two most common
  situations in terms of setup for scanning using
  ScanOARS
• Using a dedicated computer
• Your school has set up a computer that stays
  connected to the scanner all the time
• Chances are you dont need to download the
  software
• Using a docking station
• Your school has set up a docking station or USB
  connection to the scanner
• Each teacher can connect their own laptop if the
  station is available
• Chances are you WILL need to download the
  software to your laptop
• Note You need a PC this is not recommended for
  MACs

44
Download and Install ScanOARS
45
Entering Student Data into the Online Assessment
Reporting System
46
Entering Data

• Assessment information can be entered different
  ways
• Scanning Using ScanOARS
• Some implementing now
• Requires a certain level of technical expertise
• Requires a PC connected to an approved scanner
• The District has purchased a scanner for every
  elementary school and two for each secondary
  school
• May be the most efficient way for sites to get
  data into the OARS
• Can get data back within minutes with a variety
  of reports
• Hand Entry Using INSPECT
• Scores only does not allow for response analysis
  OR
• Entering Individual Responses (allows for
  response analysis)
• Administering the Assessment Online
• Requires all students to take the test at a
  computer
• Reduces use of paper/printer resources

47
Entering Data - ScanOARS
Once you have given the assessment using the test
booklet and answer sheet, you are now ready to
scan your answer documents.
STEP 1 Start ScanOARS and select Fresno USD
STEP 2 CLICKOK
48
Entering Data - ScanOARS
STEP 4 Your username and password are the same
ones that you used to login to OARS. Once you
have typed these in, CLICK OK
STEP 3 Make sure Default proxy is selected then
CLICK OK
49
Entering Data - ScanOARS
STEP 5 Put your answer documents on your scanner
and click SCAN Brother DCP8060 Face Up Top
Side First
STEP 6 Once your documents are scanned, the Send
Data to Server button will turn black. CLICK on
Send Data to Server to send your data to OARS.
TIPYou may want to take a highlighter or copy
pencil and mark forms you have already scanned.
The machine will not do this for you.
STEP 7 Exit ScanOARS
50
Approving the Scanned Data
Although you can wait and approve data later, we
recommend doing this as part of the scanning
process. Please go to the next slide for more
information regarding how to Approve your data.
51
Approving the Scanned Data Quick Start Guide

• If you chose to scan and upload your data, the
  next time you log in to OARS, you will see a
  screen asking you to review and approve the new
  data.
• Once reviewed and approved, you will have access
  to your assessment data using the OARS reports.

52
Approving the Scanned Data
STEP 1 Click on Tools.
If scanned data is ready to be approved, the
Review Data area will show you what still needs
to be approved.
If no scanned data is ready to be approved, the
Review Scanned Data area will have a message
letting you know.
53
Approving the Scanned Data

• STEP 2
• To see results for one student CLICK on Show
  Responses.
• To see results for all students CLICK on Expand
  All.

STEP 3 (Optional) CLICK on a response to change
it. Make your changes and CLICK Save or CLICK
Cancel if you made a mistake.
STEP 4 When you have completed your review,
CLICK on Approve Data.
54
Approving the Scanned Data
Once the data has been approved successfully, you
will receive a confirmation message.
You are now ready to view results using the
various reports. Please go to slide 62.
55
Entering Data INSPECT Hand Entry
SECONDARY TEACHERSYou will need to select a
section first.
Select INSPECT Item Bank. Then select the section
by clicking on the teacher name next to that
section.
56
Entering Data INSPECT Hand Entry
57
Entering Data INSPECT Hand Entry
STEP 2 Make sure INSPECT Item Bank is selected
STEP 3 Select appropriate options
IF you want response analysis select Enter
Actual Responses
STEP 4 Select the assessment you want to enter
scores for
STEP 5 Select the method of entering the data
STEP 6 Click GO
58
Entering Data INSPECT Hand Entry
This is the screen you get if you selectEnter
Actual Responses You will need to enter the
letter choice of each response if you choose this
method of entry
STEP 7 Complete the data entry process
STEP 8 Scroll to the bottom of the page and
Click Once on the Click ONCE to Save Button
59
Entering Data INSPECT Hand Entry
This is the screen you get if you selectEnter
Actual Responses You will need to enter the
letter choice of each response if you choose this
method of entry
STEP 7 Complete the data entry process
STEP 8 Scroll to the bottom of the page and
Click Once on the Click ONCE to Save Button
60
Entering Data INSPECT Online Assessment
(Preview)

• The OARS will allow you to produce an assessment
  and allow students to take the assessment online
• Every student will need to take the assessment on
  a computer
• Teachers can control things like
• The test window
• Which assessment(s) are available online
• Student Passwords
• A specific computer a student can use for taking
  the assessment (or can select ANY computer)
• Reduces paper processing
• Unfortunately early tests by REA staff indicate
  that the online assessment system was not meeting
  expectations at the time this presentation was
  posted on the Internet. Look for more details in
  an upcoming presentation.

61
Entering Data INSPECT Online Assessment
(Preview)
Unfortunately early tests by REA staff indicate
that the online assessment system was not meeting
expectations at the time this presentation was
posted on the Internet. Look for more details in
an upcoming presentation.
62
Brief Introduction to OARS Reports
63
Intro to OARS Reports

• For Teachers
• Benchmark Report for Interim Assessments (SCOE,
  Theme Skills)
• How many students were at Intensive, Strategic,
  Benchmark and Challenge
• Item Analysis
• For scanned assessments only
• Drill Down
• Starts at Grade Level/Theme, drills down to
  teacher, to student, to standard, can create
  intervention groups by standard
• INSPECT Questions (can build a test or use
  questions during lessons to check for
  understanding)
• Ability to create and monitor Intervention Groups

64
Intro to OARS Reports

• For Administrators
• STAR Data (Scale Score, Clusters, Disaggregated,
  etc.)
• Benchmark Report for Interim Assessments (SCOE,
  Theme Skills)
• By grade level
• Ability to compare classrooms
• Ability to track progress of cohorts of students
• Ability to disaggregate in many ways
• By Theme
• By skill (Reading Comp., Vocabulary, Spelling,
  Grammar)
• Summary results
• Classroom Results
• Demographic subgroups

65
Who to Call for More Help
Person Can Help With Phone
School OARS Liaison TEACHERS Your liaison should be your first call for help. Liaisons will call REA or Tech Service Staff as needed for additional support. TEACHERS Your liaison should be your first call for help. Liaisons will call REA or Tech Service Staff as needed for additional support.
Help Desk or MCS Call the Help Desk or your assigned Microcomputer Specialists (MCS) Hardware problems with your scanner Connecting to the Internet 457-2600
Bon Vang, REA Resetting Passwords Creating User Accounts 457-3958
66
Preview of Upcoming guides
Check back on http//rea.fresnounified.org/Assessm
ent.cfm Upcoming presentations may include
Using OARS-Inspect Online Assessment Using OARS
Reporting Features Creating your own
multiple-choice items using the Inspect Item
Editor