TSI Outcome Measurement

1
TSI Outcome Measurement

• A Pilot Test

2
TSI Evaluation

• Required by our funders
• Helps us track
• What works (and why)
• What doesnt work (and why)
• Enables informed decision making by all of us

3
Multiple Outcomes

• Publications
• Grants
• Patents
• Collaborative Behavior
• Investigators Perceptions of how TSI enhances
  productivity and quality
• Patients and/or Community Perceptions of how TSI
  impacts what matters to them

4
Pilot Test

• TSI is adopting existing instrument from Stokols
  et al
• Complete Dataset is goal
• High response rate
• No missing data
• Need a sample of the data in our target
  population to assess instrument performance

5
What will I do with the data?

• Ceiling Effects?
• Instrument wont capture change
• Questions are skipped?
• Cant impute opinions
• Patterned responses
• Respondents might not be taking it seriously
• Questions dont make sense?
• Respondents might not answer
• Items redundant?
• Respondents might skip or quit
• Amount of time it takes to complete?

6
Ready, Set, Evaluate

• Okay to make notes on your form
• Okay to talk out loud

7
Trust in Extant Data

• Multiple institutional dataset to capture grants,
  publications
• Want to reduce your reporting burden
• Need your assessment of existing data
• Would you believe results based on it?
• Do we (YOU) have to create our own or can we fix
  it?