Assessment Consultant

1

StudentVoice Fundamentals Training
Annemieke Rice Assessment Consultant StudentVoice
2
About StudentVoice

• Designed for higher education
• Alliances with professional organizations
• Growing network of member campuses

3
Member Campus Network
Bemidji State University Binghamton
University Bloomsburg University Brock
University Cal Poly Pomona California State
University, Chico California State University,
Dominguez Hills California State University,
Monterey Bay California State University,
Northridge California State University,
Pomona California State University, Sacramento
Canisius College Carleton College Case Western
Reserve University Catholic University of
America Central Washington University College of
Southern Nevada Colorado State University East
Carolina University East Stroudsburg
University Eckerd College Erie Community
College Florida Gulf Coast University Florida
International University Career Center Fordham
University George Mason University Gonzaga
University Hofstra University Idaho State
University Illinois State University Indiana
University of Pennsylvania Kent State Kutztown
University Long Beach City College Long Island
University Loyola University Chicago McMaster
University
University of Georgia (Career Center) University
of Kansas University of Miami University of
Michigan, Ann Arbor University of Missouri,
Columbia University of New Mexico University of
North Carolina, Charlotte University of North
Carolina, Pembroke University of North Carolina,
Wilmington University of North Dakota University
of Oklahoma University of Oregon University of
Richmond University of San Diego University of
South Carolina University of Tennessee
KnoxvilleUniversity of Texas at
Arlington University of Texas at
Austin University of Toronto University of
Toronto at Scarborough University of
Utah University of Wisconsin Madison University
of Wisconsin Milwaukee University of
Wyoming Villanova University Virginia
Commonwealth University Virginia Polytechnic
University Washington University in St.
Louis Wayne State University Weber State
University West Virginia University Western
Kentucky University Western Oregon
University William Paterson University Wright
State University York University As of January
2009
Metro State University of Denver Michigan
Technical University Michigan State
University Morgan State North Dakota State
University Northeastern University Northwestern
University Ohio State University Ohio
University Oklahoma State University Oregon State
University Pratt Institute Prince George's
Community College Purdue University,
Calumet Queens University Regis University Saint
Cloud State University Saint Joseph's
University Saint Louis Community College Saint
Louis University Salt Lake Community College Sam
Houston State University San Diego State
University Seattle University Slippery Rock
University Southern Illinois University,
Carbondale SUNY Fredonia SUNY Oswego Texas AM
University Kingsville Towson University Tulane
University University of Alaska,
Anchorage University of Arizona University of
Arkansas University of Buffalo University of
Calgary University of Colorado, Boulder
4
Types of Assessment

• Tracking/usage
• Needs and gap analysis
• Satisfaction/importance
• Outcomes
• Environmental and campus climate
• Program and policy evaluation
• Benchmarking/peer institution comparisons

5
Populations to Assess

• Students
• Staff/administrators
• Faculty
• Employers

Community members Alumni Other constituents
6
StudentVoice Features and Support

• Consultation from an assessment expert
• Remote training and professional development
  workshops
• Access to assessment resources and template
  projects
• Open participation in all benchmarking studies
• Web-based data collection
• PDAs for onsite data collection
• Upload existing data
• Online reporting

7
Consultation

• At any point during the process, experienced
• StudentVoice professionals can provide
  assistance.
• Define measurable outcomes based on goals and
  objectives
• Survey design
• Exposure to best practice
• Assistance with launching studies
• Gauging response rates
• Full technical support
• Reacting to data
• Using analysis tools
• Incorporating data into reports and presentations

Preparation
Administration
Analysis
8
Professional Development

• Webinar Series
• Designing an Assessment Project
• Learning Outcomes
• Survey Design
• Methods and Measurements
• Building a Culture of Assessment
• Reporting and Statistics
• Survey Fatigue
• and more!
• www.studentvoice.com/training

9
Community Features

• Shared Projects - example assessment projects
• Resource Centers - department specific resources
• Wiki - easy access to assessment information
• Forums - discussion boards
• Blogs - posts from assessment experts
• and more to come!

10
StudentVoice Benchmarking

• Orientation Outcomes
• Campus Recreation Impact
• Leadership Development
• Career Services/Graduating Students
• Campus Activities
• Diversity/Inclusion/Climate
• Campus Safety/Student Conduct
• Profile of Today's College Student
• https//www.studentvoice.com/app/views/about/partn
  erships/consortium.aspx

11
Benchmarking Reports
12
Project Process

• Design an assessment study
• Existing survey
• Template or shared project
• In consultation with a StudentVoice staff member
• Submit project request form in the portal
• StudentVoice prepares the study for PDA, web, or
  upload
• Institution previews and approves study
• Study is administered
• Data is available in real time for web
  assessments and after hot syncing for PDA
  assessments

13
Data Collection Web

• Send an e-mail invitation with a link to the
  project.
• Post the project onto a website.
• Data is automatically updated when completed.

14
Web-based Survey Functionality

• Open-ended responses
• Branching /skips
• Required vs. optional responses
• Min and max responses (select one or select all)
• Ranking
• Autosum
• Looping
• Customizable appearance (logos and colors)

• Customizable finish page
• Graphic integration
• Collecting identifying information/authentication
• ADA compliant

15
What makes for a good question?

• Clearly understood
• Short (both the question and the answer choices)
• Asking only one question per question
• Make all definitions, assumptions, and qualifiers
  clear
• Avoid making significant memory demands
• Avoid asking for very precise responses, as well
  as very broad generalizations
• Avoid biased, loaded, leading questions
• Avoid questions that people are uncomfortable
  answering honestly
• Let people admit they dont know or cant
  remember

16
Web Survey Practices

• Possible ways of motivating respondents to
  continue
• Make it relevant to the respondent
• Keep design simple
• Make directions clear
• Include questions on the first page
• Watch length and type of questions
• Break the survey up into multiple pages
• Utilize a progress tool
• Utilize skip patterns so that respondents do not
  have to see questions that do not apply to them

17
Contact/Invitation Checklist

• Should convey the importance of the study
• Should include a request for help
• Should guarantee confidentiality (as appropriate)
• Should provide information on how long it will
  take to complete the survey
• Should indicate the time period for which the
  survey will be accepting responses (set deadline)
• Include information on incentives
• Come from a recognizable and credible entity

18
Survey Basics Response Rate

• Develop a sampling strategy so each student gets
  asked to participate in only a certain percentage
  of surveys
• Send a prenotification e-mail
• Send reminders
• Consider smaller incentives with higher chances
  of winning (give out three 10 gift cards instead
  of one 30) as well as immediate incentives,
  which have shown to be more effective
• Incentives may be especially important in
  longitudinal studies
• Create a culture of sharing results with
  students over time they will see the value in
  thoughtful responses
• Follow-up email sharing some findings
• Cite assessment results in publicizing new
  programs/decisions

19
Data Collection PDA

• Randomly approach students at busy campus
  locations.
• Position PDAs at points of service.
• Use multiple PDAs after a campus event or program.

20
PDA Survey Functionality

• Palm
• Multiple choice questions
• Limited open ended entry
• Skips/branching
• Optional vs. required
• Min and max responses
• iPod touch
• Coming soon!

21
Administering PDA surveys

• Avoid bias
• Dont get one specific age
• group, ethnicity, or gender,
• unless that is your sampling
• method
• Can read questions to those with visual
  disabilities
• The wider the array of participants the more the
  results will vary and become more accurate
• Keep privacy/sensitivity in mind when selecting
  content and location

22
Data Collection Upload

• Paper Forms
• Collect data with paper and pencil
• Manually enter data into web or PDA survey
• Projects Outside of StudentVoice
• Incorporate reports from
• NSSE
• CIRP
• Other studies
• Import data files
• Student demographics
• Past survey data
• Upload reports from non-survey methodologies

23
Online Reporting

• Frequency tables
• Graphs
• Basic statistics (mean, median, mode, standard
  deviation,)
• Filters
• Save views
• Export report view to
• Word, PDF or Excel
• Export raw data to Excel
• or text file

24
Online Portal Demonstration

• Project Request
• Project Listing
• Project Dashboard
• Mass Mailing
• Results

• Shared Projects
• Resource Centers
• User Guide
• PDA Support
• Training

25
Questions?

• Check out the User Guide
• (Login and click on Help ? User Guide)
• Contact your Assessment Consultant
• 716-652-9400
• Annemieke Rice
• Assessment Consultant
• StudentVoice
• arice_at_studentvoice.com