2003 National Conference on Tobacco or Health

1
2003 National Conference on Tobacco or Health

• Thursday, 11 December 2003 130 pm 300 pm
• Boston Marriott Copley Place Regis Suite
• EVAL-143 Local Evaluation and Surveillance
  Programs

2
Local Evaluation and Surveillance Programs
Session Overview

• Thursday, 11 December 2003
• 130 pm 300 pm
• Marriott Copley Place Regis Suite

3
Session Speakers

• Seth Emont, Ph.D. Jeff Soukup
• White Mountain Research Associates, L.L.C.
• Tobacco Free Nebraska, Nebraska Health and
  Human Services
• Evaluating a Tobacco Control Program with
  Uncertain Funding Levels

4
Session Speakers

• Argelia Figueroa, MSc Scott Pollack, MS
• Tobacco Use Prevention Program
• Georgia Division of Public Health
• Georgia Local Tobacco Ordinance Study

5
Session Speakers

• Thomas Melnik, DrPH
• Division of Chronic Disease Prevention Adult
  Heath
• New York State Department of Health
• Local Level Tobacco Surveillance in New York State

6
Session Speakers

• Jim Chen, MD, PhD
• Department of Pediatrics
• Wayne State University School of Medicine
• State-Specific Smoking Prevalence Affecting
  National Trends in the U.S., 1990-2001

7
(No Transcript)
8
Evaluating a Tobacco Control Program with
Uncertain Funding Levels
Cheryl Wiese Jeff Willett Ian Newman Seth Emont
(consultant) University of Nebraska - Lincoln
Jeff Soukup Judy Martin Tobacco Free Nebraska NE
Health Human Services System

• Jim Chen
• Peter Finn
• Sherry Mills
• Tandi Njobe
• Abt Associates Inc.

9
Evaluating a Tobacco Control Program with
Uncertain Funding LevelsLearner Objectives

• At the end of the presentation, attendees will be
  able to plan and implement a scaled-down
  evaluation, which utilizes
• data-driven briefs
• evaluation technical assistance, and
• built-in monitoring strategies to track the
  impact of local tobacco control programming.

10
Tobacco Free NebraskaEvaluation Advisory Panel

• Monica Eischen, Office on Smoking and Health,
  Centers for Disease Control and Prevention
• Pebbles Fagan, Ph.D., National Cancer Institute,
  National Institutes of Health
• Jean Forster, Ph.D., Director, Prevention and
  Policy Program, University of Minnesota
• Karen Gerlach, Ph.D., Senior Program Officer, The
  Robert Wood Johnson Foundation
• Eric Wiesen, Office on Smoking and Health,
  Centers for Disease Control and Prevention

11
Tobacco Free NebraskaProgram Goals

• Prevent the initiation of tobacco use among young
  people
• Eliminate exposure to second hand smoke
• Identify and eliminate disparities related to
  tobacco use
• To promote tobacco use cessation among adults and
  youths

12
(No Transcript)
13
Tobacco Free NebraskaProgram Summary (continued)
Source of Chart A Broken Promise to Our
Children, The 1998 State Tobacco Settlement Five
Years Later. American Heart Association,
Campaign for Tobacco Free Kids, American Cancer
Society, American Lung Association, November 12,
2003 (page 67).
14
Tobacco Free NebraskaProgram Summary (continued)
Source of Chart A Broken Promise to Our
Children, The 1998 State Tobacco Settlement Five
Years Later. American Heart Association,
Campaign for Tobacco Free Kids, American Cancer
Society, American Lung Association, November 12,
2003 (page 67).
15
Expect the Unexpected?

• Program Components
• Community/School-based
• interventions
• Policy initiatives
• Media-based
• interventions
• Statewide Quitline
• Outreach to racial/ethnic minorities
• Youth empowerment (No Limits)

Outcomes

• Implementation/
• Mediating Factors
• Level of exposure to TFN programs
• Compliance with CDC Best Practices
• County-specific variations of model
• Level of policy tracking and
• enforcement

• Data Sources (Existing)
• Youth Risk Behavior Survey
• Adult Behavior Risk Factor Survey
• Youth Tobacco Survey
• Adult Tobacco Survey
• School Administrator Survey
• Social Climate Survey
• Pregnancy Risk Assessment Monitoring System
• NCIAA/Youth Access Compliance Data
• TRAIN
• Media print monitoring - UNL
• Data Sources (in Development)
• Quitline database

• Measures
• Tobacco use
• Quit attempts
• ETS exposure
• Policies/ordinances
• (state, county, local,
• workplace)
• Attitude/risk perception

• External Influences
• Budget allocations to TFN and staffing
• Tobacco control advocacy
• Social climate
• Effect of other agencies
• programs and Federal policies
• (e.g., RWJF, HCFA, ALA, CDC)

• Documenting Achievement of TFN Goals
• Short-Term Goals
• TFN Program growth (e.g., implementation of
• program components)
• Youth empowerment
• Public/stakeholder awareness of TFN programs
• Establishing local infrastructure for tobacco
  control
• Long-Term Goals
• Policy change (e.g., tobacco-free schools, youth
• access, smoke-free workplaces)
• Changes in public attitudes
• Changes in tobacco use behaviors
• Comparison of program success with model states

Program modifications based on interim findings
16
Birds-Eye View of Evaluation
17
User Friendly Evaluation Logic Model
Documenting Strategies for Achieving Change
Facilitators of Change
Statewide/Community
Implementation
Interventions
Mediating Factors
Achievement
of TFN Goals
Barriers to Change
18
Birds-Eye View of Evaluation Activities

• Monitor trends in adult and youth tobacco use
  through existing statewide surveys
• Compare trends in adult and youth tobacco use to
  surrounding states and the nation
• Monitor trends in adult tobacco use cessation
  through State Quitline
• Media monitoring
• Evaluation technical assistance (to state and to
  local grantees)
• TRAIN Tobacco Reporting and Information Network
• Coalition leaders and participants survey
• Qualitative interviews of key stakeholders
• Focus group of TFN staff
• Variety of Evaluation-Based Publications
• State Snapshots 2001-2003
• Local Briefs No Limits Snapshot, Building
  Public Health Infrastructure
• Process and outcome measures blueprint

19
Evaluation Activities...Revisited

• Monitor trends in adult and youth tobacco use
  through existing statewide surveys
• Compare trends in adult and youth tobacco use to
  surrounding states and the nation
• Monitor trends in adult tobacco use cessation
  through State Quitline
• Media monitoring
• Evaluation technical assistance (to state and to
  local grantees)
• TRAIN Tobacco Reporting and Information Network
• Coalition leaders and participants survey
• Qualitative interviews of key stakeholders
• Focus group of TFN staff
• Variety of Evaluation-Based Publications
• State Snapshots 2001-2003
• Local Briefs No Limits Snapshot, Building
  Public Health Infrastructure
• Process and outcome measures blueprint

20
Evaluation Activities...Revisited

• Monitor trends in adult and youth tobacco use
  through existing statewide surveys

Tracking Outcome Measures
Tracking Process Measures/ Program Implementation
21
Data-Driven Briefs

• Very targeted topics
• Brief and to the point! (3 pages)
• Highlights complementary activities at state and
  local levels
• Developed by an independent evaluation team
• Balances qualitative and quantitative data
• Written for policy makers as key audience
• Easily communicates main messages
• Key stakeholders/partners perspectives are
  incorporated

22
Examples of Data-Driven Briefs
23
Examples of Data-Driven Briefs
Nebraskans Support Funding State Tobacco
Prevention and Cessation Initiatives The 2003
Nebraska state legislature decided to no longer
use money from the Tobacco Settlement Trust Fund,
or use new money from a tax increase on
cigarettes, to fund tobacco prevention and
cessation initiatives. This decision will likely
derail many of the state's tobacco control
initiatives that were previously supported by
settlement funds. However, a large majority of
Nebraskans (including smokers) support using
settlement or tobacco tax monies to fund these
initiatives.
24
How Have the Data-Driven Briefs Been Used by
Tobacco Free Nebraska?

• Posted on website
• Disseminated to
• Tobacco control coordinators
• Partners
• Advocates
• Legislators
• Media
• Key tool for lobby team

25
For More Information...

• Contact Jeff Willett, Cheryl Wiese, Ian Newman,
  Seth Emont University of Nebraska - Lincoln
• Contact Peter Finn Abt Associates Inc.
• Contact Jeff Soukup, Judy Martin Tobacco Free
  Nebraska
• For an electronic copy of these and other
  reports, please visit the Tobacco Free Nebraska
  website http//www.hhs.state.ne.us/tfn/tfnpubrep.
  htm