New CTE Follow-up Survey

1
New CTE Follow-up Survey
2
Training Topics

• Discuss Purpose
• Explain Need for Good Response Rate
• Explain Interviewer Responsibilities
• Introduce the Survey
• Mock Interview
• Practice (2 w w/o stumbling blocks)
• Discuss Problems
• Consistency Confidentiality
• Lessons on making calculations
• Closely Monitor

3
Purpose Use

• p1

• Provide data to meet reporting needs.
• Used for

• Perkins III Core Performance Indicators.

• Ranking programs for State Added Cost funding

• LEAs to use for program improvement aiding
  students not placed

• Program reviews

• Reporting CTE program impact to public

4
The Interview Process Qualities of Good
Implementation

• p6-8

• Consistency
• Response Rate
• Interviewer Responsibilities

5
Consistency

• p6

• Goal to collect data from all students
  statewide

• in exactly the same way

• at exactly the same time

• Timing 9 mo after June of senior year

6
Response Rate

• P6-8

• Acceptable Rate

• 90 - 100

• Unacceptable Rate

• lt 50

• Relationship to Placement Rate

7
Tips for Improving RR

• A-C

• Use a phone survey method

• Call from the school phone

• Leave messages on answering machines

• Call in evenings on weekends

• Make at least 6 attempts

• Other suggestions in Attachment C

8
Interviewer Responsibilities

• P9-10

• Be consistent

• Follow question wording exactly

• Be objective

• Follow the script

• Check your work

BEFORE Hanging Up

• Enjoy your work

9
Follow Wording Exactly

• p9

• Would you climb a tree?

• Should you climb a tree?

• Could you climb a tree?

10
Be Objective

• p10

• WHY do you say that?

• Why do YOU say that?

• Why do you say THAT?

11
New CTE Follow-up Phone Survey

• P11-22

• Upfront
• Opening
• Student contact
• Proxy contact
• Part A Current Status
• Part B School/Training
• Part C Employment
• Part D Only if Not Working
• Closing

12
Opening Student Contact

• p11

Hello, this is _____ from _____. Is ____ there?
Student Hi _____. How are you?
Single program completed ______, in _____ grade you completed a program in ________. Do you have a few minutes to answer some questions about what you are doing now? All responses will be kept confidential.
13
Student contact

• p11

Multiple programs completed We are talking with students who completed programs in high school. Do you have a few minutes to answer some questions about what you are doing now? All responses will be kept confidential.
Our records show that you completed the _____, _____, and _____ programs. Are you pursuing one of these more than the other? Which one? ______________________ This is the class I would like you to think about during this interview.
If no We can only follow up on one program. Which would you like to think about during this interview? ____________________
14
Proxy contact

• p11

Proxy We are talking with students who completed high school programs to see how they are doing. Student name was in the _____ class. How could I reach him/her?
If unreachable You could probably answer some of the questions. It would only take a couple minutes and all responses will be kept confidential.
15
Part A Current Status

• p12

• 1. Lets start what youre doing now. Are you
  going to school? Working?

Verify applicable part of answer with statement
before coding.
Yes No a. in a training program or
attending school or college? ? ? b. working as
an apprentice? (If Yes Q1c Yes) ? ?
c. working? ? ?
d. on full-time, active duty in the
military? ? ? (If Yes Q1c Yes Q7
40 hrs/wk) e. on part-time duty in the military?
? ? (If Yes Q1c Yes Q7 40 hrs/wk)
f. Other (specify code from list
below) ____ 1. unpaid leave of absence
(disability, Family leave) 2. on seasonal layoff
16
Q1 - Skip Options

• p13

• If working, but not in school or training,
  ? Skip to Part C.
• If Other only,
• ? Skip to Part D.

17
Part B School/Training

• p14

• I have some questions about your schooling or
  training.

2. In your major area of study or training, how much do you use the skills you learned in this program? Would you say you use them a lot, some, hardly ever, or not at all? If a 3 (Hardly ever) or 4 (Not at all) Hardly Not A lot Some Ever at all ? ? ? ?
2a. Right now you dont use your training, but how much do you anticipate using it in the future . . . a lot, some, hardly ever, or not at all? ? ? ? ?

18

• p15

3. Where are you going to school? (Note If
enrolled in more than one, identify the primary
one.)
? business or trade school, or career center
? community college ? college/university
? military (National Guard, West Point,
Annapolis, DLI, Merchant Marines,
etc.) ? other ___________________________
19

• p16

4. What type of program are you in? Read list
? certificate ? associate degree ? bachelors
degree ? other (specify) ___________________
20
Part B Skip Options

• p16

• If No Current job, ? Skip to Part D.

21
Part C Employment

• p17

• Now, Id like to talk about your job as it
  relates to your (selected) program.

5. On your job, how much would you say youre
using the skills you were taught? Would you say
you use them . . . ? ? A lot ? Some ?
Hardly ever ? Not at all
22

• p18

6. How strongly do you agree with the statement,
I am satisfied with my present job? Do you . . .
?
? Strongly agree ? Agree ? Disagree ?
Strongly disagree
23

• p18

7. How many hours a week do you
work? ______________ hrs/week
7a. If not specific Would you say its 35 hrs a
week or more? ? Yes ? No
24

• p19

8. Including tips and commissions, how much do
you make an hour? _________ / hr
? Skip to Comments
25
Part D Only if Not Working

• p22

• 9. Are you currently looking for a job?
• ? Yes ? No

26
Comments

• p22

• Thank you. Thats all I needed.

Now, are there any comments youd like to make
to help us improve our programs.
27
Break
? Back in 10 min
28
Proxy Survey

• p

• Part A Current Status
• 1. Lets start with what (she/he) is doing now.

• Part B School/Training
• 3. Where is (he/she) going to school?

4. What type of program is (he/she) in?
29

• p

• Part C Employment
• 7. How many hours a week does (he/she)
  work?
• 7a. If not specific Would you say its 35
  hours a week or more?
• 8. Including tips and commissions, how much
  does (he/she) make an hour?
• ? Skip to Comments.

• Part D Only if Not Working
• 9. Is (he/she) currently looking for a job?

30
Consistency

• p6

• Goal to collect data from all students
  statewide
• in exactly the same way,
• at exactly the same time.

31
Prefaces to Avoid Using

• p20

• Apologetic If you dont mind my asking
• Blameless This is confidential, but the state
  needs it.
• Estimates Approximately how much
• On guard! I have to ask this question.
• Proxy You may not be able to answer
• Opt out You dont have to answer

32
Role Play 1

• p

• Practice Conducting the Survey
• Choose a partner.
• Go to a room
• Practice both roles the interviewer and the
  student.
• Practice at least three times.
• Switch roles with your partner.
• Be KIND. Do not throw in stumbling blocks.

? Back in 15 min
33
Potential Problem Solution 1

• Where are you going to school?
• ? I take a class at the career center.
• ? Are you registered at the career center?
• ? Im registered at the community college, but
  they hold the class at the career center.

34
Potential Problem Solution 2

• On your job, how much would you say youre using
  the skills you were taught?
• ? Student from automechanics program working
  at a dealership says not at all.

• ? What should the interviewer do?

?

• a. Mark the answer and go on.
• b. Review skills they learned ask again.
• c. Explain why thats not possible ask again.

35
Potential Problem Solution 3

• How strongly do you agree with the statement, I
  am satisfied with my present job?
• ? Student working at McDonalds
• Strongly Agrees.

? What should the interviewer do?
a. Review potential for the program they took.
b. Talk about benefits ask again.
?
c. Mark the answer and go on.
36
Potential Problem Solution 4

• Including tips and commissions, how much do you
  make an hour?
• ? The completer has more than 1 job.
• ? What should the interviewer do?

? Combine and estimate the overall hourly wage.
37
Potential Problem Solution 5

• Including tips and commissions, how much do you
  make an hour?
• ? The interviewer is uncomfortable about asking
  the question.
• ? What should the interviewer do?
• a. Apologize, say I know this is sensitive,
  but
• b. Ask for an estimate, About how much
• c. Explain its optional.

? Just ask the question.
38
Role Play 2

• Practice Conducting the Survey
• Choose a partner/new partner
• Go to a room
• Practice both roles (interviewer responder)
• Practice both surveys (phone proxy)
• Do the survey twice (2 each)
• Go ahead -- throw in stumbling blocks

? Back in 15 min
39
Handling Difficult Calls

• A-C

• Talkative

• Grouchy

• Irate

40
Best Weapon
41
Confidentiality

• p

• Part of the 2 Big Cs
• What was the first C?
• Meaning
• A promise by interviewers who know the response
  of specific completers not to reveal those
  responses to anyone.
• Keeping responses a secret

Consistency
42
Calculations

• p19

• Weekly rate based on 40 hr/wk
• 400/wk 40hr/wk 10.00/hr

• Monthly rate based on 2080 hr/yr
• 1200/mo x 12mo 14,400/yr
• 14,000/yr 2080 hr/yr 6.92/hr

• Annual rate based on 2080 hr/yr
• 18,000/yr 2080 hr/yr 8.65/hr

43
Strategies for Making ContactChallenges

• p8

• Updated records
• Mobility of students
• When to call
• The Telephone Consumer Protection Act states that
  telephone solicitation cannot occur before 800
  a.m. or after 900 p.m
• Schools technically are not solicitors
• State still recommends keeping within the 8
  a.m. - 9 p.m. time frame

44
Challenges (contd)

• p9

• Answering Machines
• Caller ID
• Reaching Students
• Disconnects
• Callbacks Cant Get Through

45
Solving Problems

• No finite list of problems
• Some may be area specific
• SSC will help with solutions
• Careful about making snap decisions
• All solutions are not easy
• Record enough info no need to recall
• Keep own list
• Experience in handling

46
Process Problems

• Contact
• Dr. Jill Kroll
• Office of Career and Technical Preparation
• (517) 241- 4354

47
Lunch
? Start at 100 pm