ILASPIRE Evaluation Project Violeta Carrin Statewide ASPIRE Evaluation Coordinator Phone: [phone]

1
IL-ASPIRE Evaluation ProjectVioleta
CarriónStatewide ASPIRE Evaluation Coordinator
Phone [phone]Hank BohanonStatewide
ASPIRE Evaluation DirectorCenter for School
Evaluation, Intervention and Training
(CSEIT)Loyola University Chicago820 N. Michigan
Avenue, Chicago, IL 60611cseit_at_luc.edu
2
Evaluation goals across ISBE projects

• Coordinating evaluation of technical assistance
  projects, with common evaluation
• Questions
• If people are trained, do they implement?
• If people implement, do they do it with
  integrity?
• If people implement with integrity, do they
  sustain?
• If interventions sustain, what is the impact on
  students?
• Components
• Processes
• Practice and training
• Systems in place
• Outcome data

3
Self-Assessment of Problem Solving Implementation
(SAPSI v2.1)
4
(No Transcript)
5
(No Transcript)
6
(No Transcript)
7
(No Transcript)
8
(No Transcript)
9
(No Transcript)
10
(No Transcript)
11
(No Transcript)
12
Preliminary Results
13
In Progress
Achieved
Not Started
Maintaining
14
In Progress
Not Started
Achieved
Maintaining
15
In Progress
Not Started
Achieved
16
In Progress
Achieved
Not Started
Maintaining
17
In Progress
Achieved
Not Started
18
In Progress
Achieved
Not Started
Maintaining
19
In Progress
Not Started
20

• Test scale mean(unstandardized items)
• 
  average
• item-test
  item-rest inter-item
• Item Obs Sign correlation
  correlation covariance alpha
• -------------------------------------------------
  -----------------------------
• q1 26 0.7209
  0.4451 .1821795 0.5931
• q2 26 0.7975
  0.5809 .1385897 0.4920
• q3 26 0.7629
  0.5370 .1592308 0.5286
• q4 26 0.5207
  0.2261 .2833333 0.7193
• -------------------------------------------------
  -----------------------------
• Test scale
  .1908333 0.6616
• --------------------------------------------------
  -----------------------------
• Test scale mean(unstandardized items)
• 
  average
• item-test
  item-rest inter-item
• Item Obs Sign correlation
  correlation covariance alpha
• -------------------------------------------------
  -----------------------------
• q5 26 0.7772
  0.6931 .1972527 0.8191

21
Test scale mean(unstandardized items)

average item-test
item-rest inter-item Item Obs
Sign correlation correlation covariance
alpha ----------------------------------------
-------------------------------------- q13a
26 0.7722 0.7023
.4587692 0.9248 q13b 26
0.8991 0.8547 .4027692
0.9097 q13c 26 0.8616
0.7982 .4049231 0.9159 q13d
26 0.8991 0.8547
.4027692 0.9097 q13e 26
0.8213 0.7642 .4481026
0.9198 q13f 26 0.7891
0.7051 .4321026 0.9249 q13g
26 0.8260 0.7566
.4254359 0.9196 ----------------------------
--------------------------------------------------
Test scale
.4249817 0.9289 -------------------
--------------------------------------------------
---------- Test scale mean(unstandardized
items)
average
item-test item-rest inter-item Item
Obs Sign correlation correlation
covariance alpha ------------------------
--------------------------------------------------
---- q14 26 0.7678
0.5583 .4292308 0.7342 q15
26 0.8128 0.5192
.3615385 0.7939 q16 26
0.9022 0.7531 .2076923
0.4927 ------------------------------------------
------------------------------------ Test scale

.3328205 0.7638 -----------------------------
--------------------------------------------------
22
Test scale mean(unstandardized items)

average item-test
item-rest inter-item Item Obs
Sign correlation correlation covariance
alpha ----------------------------------------
-------------------------------------- q17
26 0.7979 0.6284
.3771795 0.7634 q18 26
0.7768 0.6225 .4097436
0.7693 q19 26 0.8302
0.6685 .3438462 0.7438 q20
26 0.7956 0.6073
.3707692 0.7751 ----------------------------
--------------------------------------------------
Test scale
.3753846 0.8113 -------------------
--------------------------------------------------
---------- Test scale mean(unstandardized
items)
average
item-test item-rest inter-item Item
Obs Sign correlation correlation
covariance alpha ------------------------
--------------------------------------------------
---- q21 26 0.6275
0.4155 .184 0.7752 q22
26 0.7779 0.6314
.152 0.7145 q23 26
0.6560 0.4751 .1803077
0.7565 q24 26 0.5665
0.4433 .2098462 0.7665 q25
26 0.7616 0.6219
.1593846 0.7184 q26 26
0.7432 0.5982 .1636923
0.7250 ------------------------------------------
------------------------------------ Test scale

.1748718 0.7774 -----------------------------
--------------------------------------------------
23
Test scale mean(standardized items)

average item-test
item-rest inter-item Item Obs
Sign correlation correlation correlation
alpha ----------------------------------------
-------------------------------------- q1
26 0.5581 0.5230
0.3902 0.9520 q2 26
0.5320 0.4954 0.3914
0.9522 q3 26 0.5378
0.5016 0.3911 0.9522 q4
26 0.3041 0.2586
0.4014 0.9541 q5 26
0.6405 0.6102 0.3866
0.9513 q6 26 0.6960
0.6694 0.3842 0.9508 q7
26 0.7416 0.7183
0.3822 0.9504 q8 26
0.7401 0.7166 0.3822
0.9505 q9 26 0.4253
0.3839 0.3960 0.9531 q10
26 0.4913 0.4527
0.3932 0.9526 q11 26
0.6241 0.5928 0.3873
0.9515 q12 26 0.6523
0.6227 0.3861 0.9512 q13a
26 0.7044 0.6784
0.3838 0.9508 q13b 26
0.8505 0.8360 0.3774
0.9495 q13c 26 0.8417
0.8265 0.3778 0.9496 q13d
26 0.8258 0.8092
0.3785 0.9497 q13e 26
0.7410 0.7176 0.3822
0.9504 q13f 26 0.6765
0.6485 0.3850 0.9510 q13g
26 0.8197 0.8025
0.3788 0.9497 q14 26
0.3256 0.2807 0.4004
0.9539 q15 26 0.7906
0.7711 0.3800 0.9500 q16
26 0.6188 0.5871
0.3876 0.9515 q17 26
0.6558 0.6264 0.3859
0.9512 q18 26 0.6868
0.6595 0.3846 0.9509 q19
26 0.7109 0.6853
0.3835 0.9507 q20 26
0.6937 0.6669 0.3843
0.9509 q21 26 0.6106
0.5784 0.3879 0.9516 q22
26 0.7045 0.6785
0.3838 0.9508 q23 26
0.3898 0.3471 0.3976
0.9534 q24 26 0.3624
0.3187 0.3988 0.9536 q25
26 0.6853 0.6580
0.3846 0.9509 q26 26
0.7501 0.7274 0.3818
0.9504 ------------------------------------------
------------------------------------ Test scale

0.3868 0.9528 -------------------------------
------------------------------------------------
24
(No Transcript)
25
Test scale mean(unstandardized items)

average item-test
item-rest inter-item Item Obs
Sign correlation correlation covariance
alpha ----------------------------------------
-------------------------------------- q1
26 0.5622 0.5254
.2305327 0.9537 q2 26
0.5360 0.4987 .2315434
0.9539 q3 26 0.5357
0.5001 .2320463 0.9539 q4
26 0.2897 0.2484
.2387196 0.9556 q5 26
0.6386 0.6120 .2308553
0.9530 q6 26 0.6893
0.6634 .2285161 0.9526 q7
26 0.7382 0.7150
.2268337 0.9522 q8 26
0.7557 0.7325 .2254458
0.9520 q9 26 0.4176
0.3800 .2357204 0.9547 q10
26 0.4743 0.4526
.2379818 0.9542 q11 26
0.6218 0.5914 .2300232
0.9532 q12 26 0.6666
0.6394 .2291133 0.9528 q13a
26 0.7116 0.6889
.2289562 0.9525 q13b 26
0.8606 0.8456 .2214723
0.9510 q13c 26 0.8508
0.8338 .2204946 0.9510 q13d
26 0.8394 0.8224
.2220744 0.9512 q13e 26
0.7431 0.7225 .228225
0.9523 q13f 26 0.6855
0.6553 .2264615 0.9527 q13g
26 0.8175 0.7989
.2232076 0.9514 q14 26
0.3132 0.2741 .2383706
0.9553 q15 26 0.7941
0.7711 .2218941 0.9516 q16
26 0.6145 0.5808
.2291067 0.9533 q17 26
0.6580 0.6257 .2272275
0.9529 q18 26 0.6826
0.6557 .2283904 0.9527 q19
26 0.7240 0.6951
.2243226 0.9523 q20 26
0.7043 0.6733 .2247312
0.9525 q21 26 0.6182
0.5863 .2296162 0.9532 q22
26 0.7031 0.6774
.2277304 0.9525 q23 26
0.3689 0.3289 .2367361
0.9551 q24 26 0.3335
0.3075 .2398098 0.9548 q25
26 0.6759 0.6505
.2295004 0.9528 q26 26
0.7459 0.7252 .228038
0.9522 ------------------------------------------
------------------------------------ Test scale

.229178 0.9544 ------------------------------
-------------------------------------------------