BOIVerify Introducing Grid-Based Verification to the NWS

1
BOIVerifyIntroducing Grid-Based Verification to
the NWS

• Ken Pomeroy

Tim Barker
RFC Verification Workshop, 08/15/2007
2
BOIVerify Marketing Slogan
Dragging the NWS kicking and screaming into
grid-based verification since 2005
3
Grid-basedVerification 2007
Grid-basedVerification 20XX
4
What it does

• Archives data
• Capacity has been provided for 200 days worth of
  data in WR
• Provides an interface for analysis
• Raw data
• MAE, bias
• Threshold stats

5
Four verification options
Select a parameter
Select model(s)
Select day(s) and model run(s)
6
Grid Stats
7
Distributions - Histogram
8
Distributions Scatter Plot
9
Time Series
10
The Present

• BOIVerify can currently verify Temp, RH, and Wind
• Allows us to move from point-based to grid-based
  verification
• Dependent on MatchObsAll analysis
• Requires QCing of obs using QCobs application
  developed by Larry Greiss (SOO, Hanford)

11
The Future!

• Will verify QPF and PoP
• High impact verification
• Not just errors, but types of errors timing,
  location, magnitude
• Use of RTMA for analysis
• Advantage no need to manually QC observations

12
Verification

• Its not a bad word!!
• Not comparing office to office, or forecaster to
  forecaster
• Want to know how we can improve, not dwell on how
  we did
• Use data to improve the forecast process

13
For More Information

• http//ww2.wrh.noaa.gov/ssd/digital_services/