Evaluation

1
Understanding Evaluation Jane Willis Willis
Newson
2
Why evaluate?

• To improve working methods and inform the
  development of future projects
• To demonstrate health outcomes
• To demonstrate financial accountability

3
What is evaluation?

• Evaluation involves gathering evidence before,
  during and after a project and using it to make
  judgements about what happened.
• The evidence should prove what happened and why,
  and what effect it had.
• The evidence can also help you to improve what
  you are doing during the project and what you do
  next time (Woolf, 2004).

4
What might you evaluate?

• Measurable outcomes and impacts
• peoples experiences, feelings, changes in
  health, increase in morale or confidence
• Outputs
• number of participants, artworks created
• Process
• Critical but constructive look at the process to
  ask whether there is room for improvement

5
How to evaluate?

• Set clear, measurable and achievable objectives
• Understand why you are evaluating, for whom and
  what you want to know
• Review possible evaluation methods
• Appropriate to the project, the people you are
  working with and the budget you have
• Plan the evaluation at the outset of the project,
  including ethical impacts and implications as
  well as data protection issues

6
Research and Evaluation

• Research is concerned with
• Creating potential new knowledge which can be
  generalised to the wider population
• Its aim is to influence clinical practice and
  policy as a whole
• All research requires approval from a relevant
  Research Ethics Committee and approval from the
  trust or trusts where it will take place

7
The Evidence Base

• The integration of the visual and
• performing arts in healthcare has been
• shown to
• Induce significant differences in clinical
  outcomes
• Reduce amount of drug consumption
• Shorten length of stay in hospital
• Improve patient management
• Contribute towards increased job satisfaction
• Enhance the quality of service

8
The Hierarchy of Evidence National NHS policy
and guidelines Multi site studies systematic
reviews Randomized control
trials Regional PCTs Evidence base
Literature review Single project outcome
evaluation Local Trust Board Arts
Committees Single project qualitative or
process evaluation Project Project
funders Routine monitoring Participants
and stakeholders Practice led
evaluation Project manager / project
team Anecdotal evidence Professional
opinion
9
Different Types of Evaluation

• Literature review
• Quantitative outcomes study
• Qualitative evaluation identifying impacts and
  process issues

10
Using the existing evidence base

• Literature search using Google
• Literature search using research databases
• Existing arts and health literature reviews and
  systematic reviews
• Arts in health a review of the medical
  literature Dr Rosalia Staricoff
• The impact of art, design and environment in
  mental healthcare a systematic review of the
  literature Professor Norma Daykin

11
Arts in health a review of the medical
literature Dr Rosalia Staricoff

• Includes 385 references from medical literature
  related to the effect of the arts and humanities
  in healthcare.
• Effective approaches to patient management and to
  the education and training of health
  practitioners.
• Identifies the relative contribution of different
  artforms to the final aim of creating a
  therapeutic healthcare environment.

12
Arts in health a review of the medical
literature Dr Rosalia Staricoff

• It highlights the crucial importance of the
• arts and humanities in
• inducing positive physiological and psychological
  changes in clinical outcomes
• reducing drug consumption
• shortening length of stay in hospital
• increasing job satisfaction
• promoting better doctor-patient relationships
• improving mental healthcare
• developing health practitioners empathy

13
A Study of the Effects of Visual and Performing
Arts in Health Care Dr Rosalia Staricoff

• The first ever scientific, clinical evaluation
  into arts in health
• Based at Chelsea and Westminster Hospital, London
• Demonstrates that the integration of visual and
  performing arts into the health care environment
  induces psychological, physiological and
  biological outcomes which could have clinical
  significance

14
Building on the Evidence Qualitative Research
on the impact of Arts in Mental Health Care
Professor Norma Daykin

• University of the West of England, in
  collaboration with Avon and Wiltshire Partnership
  Mental Health NHS Trust
• Two year study funded by the Estates and
  Facilities Division of the Department of Health
• Used qualitative methods to explore participants
  experiences of commissioned and participatory
  arts in mental healthcare settings
• Identified specific benefits of arts in these
  settings and pinpointed aspects of arts that are
  viewed by service users and staff as enhancing
  care
• Explored the challenges facing those seeking to
  enhance mental healthcare settings using arts
  based approaches
• Identified prerequisites for the successful
  delivery of arts projects in these settings

15
Building on the Evidence Qualitative Research
on the impact of Arts in Mental Health Care
Professor Norma Daykin

• Summary of key findings
• Four pathways were identified through which arts
  enhanced mental healthcare environments
• Artworks helped to create modern, fit for
  purpose environments
• Artworks enhanced valued aspects of healthcare
  environments, using carefully chosen materials
  and evoking popular themes such as nature and
  locality
• Artworks minimised negative associations such as
  institutionalisation and stigma
• For service users, participation in arts offered
  the opportunity to reengage with identities other
  than that of patient

16
Useful resources and partners Universities and
research centres

• University of the West of England
• Canterbury Christ Church University
• Anglia Ruskin University,
• University of Central Lancashire,
• University of Durham,
• University of East London,
• University of Leeds,
• Manchester Metropolitan University,
• Northampton University
• University of Nottingham
• British Society of Arts Therapy
• Nordoff-Robbins Music Therapy Centre
• British Society of Music Therapy
• British Association of Dramatherapists
• Goldsmiths, University of London
• Dance Movement Therapy

17
Useful resources and partners Journals

• Arts and Health An International Journal for
  Research, Policy and Practice.
• Published in association with the Society for the
  Arts in Healthcare. The journal aims to
• provide a pioneering international forum for the
  publication of research, policy and best
• practice within the interdisciplinary field of
  arts and health.

18
Useful resources and partners Toolkits and
Guides

• Self-evaluation
• Scottish Arts Council Evaluation Toolkit
• Practical monitoring and evaluation a guide for
  voluntary organisations
• The artists development toolkit
• Sharing practice a guide to self-evaluation in
  the context of social exclusion
• Built-in, not bolt-on engaging young people in
  evaluation and consultation
• Evaluating Community Arts and Community Well
  Being.
• Monitoring evaluating arts events why bother?

19
Useful resources and partners Policy

• Report of the Review of the Arts and Health
  Working Group
• A Prospectus for Arts and Health
• The arts, health and wellbeing

20
For more information contact Jane
Willis Willis Newson Email jane_at_willisnewson.co
.uk Telephone [phone]