The Pfizer Southern HIVAIDS Prevention Initiative CrossSite Program Assessment: Opportunities, Chall

1
The Pfizer Southern HIV/AIDS Prevention
Initiative Cross-Site Program Assessment
Opportunities, Challenges and Preliminary Findings

• Jamillah T.M. Berry, M.S.W., Doctoral Candidate
• Morehouse School of Medicine
• Prevention Research Center
• February 2006

2
Presentation Goals

• Describe the Pfizer Foundation Southern HIV/AIDS
  Initiative
• Discuss the Development and Administration of the
  Cross-site Program Assessment Survey (C-PAS)
• Report Preliminary Findings
• Share Lessons Learned and Practice Implications

3
Pfizer Foundation Southern HIV/AIDS Initiative

• Designed to address the growing epidemic of
  HIV/AIDS in the Southern region of the U.S.,
  primarily among minority communities and women in
  the inner cities and rural areas
• Funds granted to small and mid-size community
  based organizations (CBOs) that support
  underserved multi-cultural communities
• Grantees located in urban and rural areas of nine
  southern states AL, FL, GA, LA, MS, NC, SC, TN,
  TX

4
Program Assessment Team

• Elleen M. Yancey, Ph.D., Principal Investigator
• Robert M. Mayberry, Ph.D., Lead Evaluator
• Tabia Henry Akintobi, M.P.H., Program Manager
• Pamela Daniels, M.P.H., M.B.A, Data Manager
• Jamillah Berry, M.S.W., Program Assistant

5
Program Assessment Approach

• Determine extent to which each Grantees goals,
  objectives and outcomes have been attained.
• Assist Grantees in clarifying and establishing
  measurable performance indicators/outputs and
  timelines for outcomes.
• Assist Grantees with defining or enhancing their
  intervention implementation plan.

6
Program Assessment Approach

• Evaluation will not be a One Size Fits All
  approach 
• Requires sensitivity to the diversity among
  Grantees in
• Organizational Capacity
• Evaluation Skills
• Program Types
• Populations Served

7
The Pfizer Southern HIV/AIDS Prevention
Initiative Cross-Site Program Assessment

• Preliminary
• Activities

8
Logic Model Training
Goal/Objective
Inputs
Outcomes
Long Term
Strategies/ Activities
Outputs
Short Term
Medium Term
Achieved Goal/Objective
9
CBO-MSM PRC Communication and Needs Assessment
10
The Pfizer Southern HIV/AIDS Prevention
Initiative Cross-Site Program Assessment

• Development and Administration

11
C-PAS Design

• The C-PAS was designed to inform program
  assessment through capturing the following
  information
• Current Program Implementation and Recent Changes
• Data Collection Processes
• Current Statuses of Program, Data Collection and
  Evaluation Planning
• Technical Assistance Needs

12
C-PAS Administration

• Self-administration of Questionnaires
• Sent by U.S. and Electronic Mail
• Two U.S. Mail Reminders and One Telephone
  Reminder

13
C-PAS Administration

• Surveys Completed by one Executive Director and
  one Program Staff per agency.
• 39 Grantees, Representing 20 Organizations,
  Completed the C-PAS.
• There was a 90.7 Survey Response Rate.

14
The Pfizer Southern HIV/AIDS Prevention
Initiative Cross-Site Program Assessment

• Findings

15
Race/Ethnic Groups Served

• African American/Black 64.1
• Hispanic/Latino 43.6
• Caucasian/White 28.2
• Haitian 5.1
• Asian/Pacific 2.6
• All Racial/Ethnic Groups 41.0

16
Intervention/Service Types

• Health Communication/Public Information 74.4
• Group-Level Interventions 71.8
• Outreach 66.7
• Counseling and Testing 53.8
• Individual-Level Interventions 53.8
• Other Interventions (i.e., community-level) 35.9
• Prevention Case Management 30.8
• Partner Counseling/Referral Services 28.2

17
Program Planning,Implementation, and Evaluation
18
Community Program Planning, Implementation, and
Evaluation
19
Community Program Planning, Implementation, and
Evaluation
20
Types of Data Collected
21
Program Evaluators Identified
22
Technical Assistance Needs
23
The Pfizer Southern HIV/AIDS Prevention
Initiative Cross-Site Program Assessment

• Lessons Learned

24
Demystifying Evaluation and Its Utility

• Evaluation as integral rather than punitive
• Part of the planning and implementation of any
  intervention
• Involves constant feedback (both positive and
  negative) to all parties
• Insures that agreed upon objectives can be
  achieved in specified period of time

25
Challenges and Opportunities

• Providing Technical Assistance to Funders on the
  Two-Way Learning Which Occurs through
  Community-Based Participatory Evaluation
• Finding Creative Ways to Develop Evaluation
  Capacity Across a Broad Spectrum of Diverse CBOs

26
The Pfizer Southern HIV/AIDS Prevention
Initiative Cross-Site Program Assessment

• Practice Implications

27
Program Assessment Activities in Response to
C-PAS Findings

• Evaluation Capacity Building Training
• Ability to Use Logic Models as Guide for Program
  Development
• Ability to Develop Survey Questions to Meet
  Program-Specific Needs
• Ability to Conduct Focus Groups
• Entering and Analyzing Collected Data Using a
  Computer

28
Program Assessment Activities in Response to
C-PAS Findings

• Web Conferences
• One-on-One Technical Assistance
• Community Based Participatory Evaluation Manual

29
Next Steps

• Second and Final Administration of C-PAS
• Comprehensive Review of all Collected Data
• Dissemination of Findings through Publication and
  Presentations
• On-going Program Implementation Informed by
  Lessons Learned

30
Thank You!For More Information Regarding the
Pfizer Southern HIV/AIDS Prevention Initiative
Cross-site Program Assessment

• Contact Tabia Henry Akintobi, MPH
• Phone [phone]
• Email takintobi_at_msm.edu