Frames Evaluation: Focus on Methodology October 28, 2004

1
Frames Evaluation Focus on MethodologyOctober
28, 2004

• Shawna Waugh
• Energy Information Administration

2
Frames Evaluation

• Purpose
• Five EIA Surveys in Manufacturing Sector
• Proposed Methodology for Frame Evaluation
• Applied to EIA-5
• Applied to EIA-63a
• Proposed Report
• Whats Next?

3
Purpose of Frame Evaluation

• Evaluate coverage of five EIA frames in the
  manufacturing sector
• Identify differences between EIA and Census
  surveys which impact coverage
• Identify characteristics of establishments
  missing from EIA frame

4
5 EIA Surveys in Manufacturing Sector

• Coal Surveys
• EIA-3, Quarterly Coal Consumption and Quality
  Report, Manufacturing Plants
• EIA-5, Quarterly Coal Consumption and Quality
  Report, Coke Plants
• Renewable Surveys
• EIA-63a, Annual Solar Thermal Collector
  Manufacturing Survey
• EIA-63b, Annual Photovoltaic Module and Cell
  Manufacturing Survey
• Electricity Survey
• EIA-860, Annual Electric Generator Report
  (Combined Heat and Power Plants)

5
Summary of Frame Evaluation
6
Methodology-Matching

• Identify establishments on EIA frames
• Match establishments on EIA frames to
  establishments on the Census Bureaus Business
  Register
• Match those establishments that are classified in
  the manufacturing sector to detailed product code
  data from the 2002 Economic Census
• Research establishments that do not match

7
Methodology-Findings

• Summarize results
• By count
• By volume
• Summarize differences between frames
• Classification of establishments
• Boundary of establishments
• Characteristics of missing establishments
• Location (state)
• Size of establishments
• Type of establishments

8
Matching for EIA-5 Frame

• Identify coke plants on EIA frames (EIA-5)
• Match EIA establishments to establishments on
  Economic Census
• Identify if establishments produce coke or breeze
• Research establishments that do not match

9
Matching for EIA-63a Frame

• Identify establishments on EIA frames (63a)
• Match those EIA establishments to Economic Census
  in manufacturing sector
• Identify if matched establishments produce solar
  thermal collectors using 10-digit product code,
  333414A136
• Research establishments that do not match

10
Proposed Results for 63aCoverage by count
(establishments)

• Number of matched est. on EC that produced
  solar panels
• Number of active in-scope est. on EC that
  produced solar panels

11
Proposed Results for 63aCoverage by value of
shipments ()
Unweighted value of shipments of matched est.
on EC that produced solar panels
Unweighted value of shipments of active in-scope
est. on EC that produced solar panels
12
Proposed Report

• Matching
• Coverage
• By count ()
• By volume ()
• Similarities and differences between surveys
• Purpose of survey
• Frame
• Questionnaire Design
• Characteristics of establishments missing on EIA
  frame
• Location (State or Census Region)
• Size/type of establishment

13
Whats next?

• By December 2004
• Finalize results for
• EIA-63a
• EIA-63bEIA-5
• Perform preliminary matching for
• EIA-3
• EIA-860
• By July 2005
• Finalize results for
• EIA-3
• EIA-860