Sensor Performance Statistics

1
Sensor Performance Statistics

• TAMDAR (and other aircraft) observations are
  compared with NMC 20km RUC 1-h forecast
• RUC forecast interpolated in x,y, and log-p to
  each observation point
• no TAMDAR data used in NMC RUC
• No data below 950 mb are included
• We dont consider the RUC perfect, but it is
  consistent in space and time, so can reveal some
  observation errors

2
Distribution of TAMDAR obs in the vertical
27-March - 9-April, 0030Z-0130Z
3
Airline Comparison, 27 March - 9 April, in TAMDAR
region, daytime only, p gt 500 mb

• Airline --------Temperature ----- ------Wind
  Speed --------
• N RUC-avg Bias Std N
  RUC-avg Bias Std
• AA 21188 1.77 -0.04 0.89 21182
  12.40 -0.08 2.49
• Canada 12636 -0.91 0.35 1.45 12633
  14.24 -0.32 4.08
• DL 14936 -0.88 0.21 1.21 13592
  15.66 0.42 4.01
• FX 33373 2.48 -0.09 1.18 33327
  13.14 -0.12 3.16
• NW 7262 -3.32 0.31 1.17 7262
  12.90 0.24 2.79
• TAMDAR 85676 1.08 -0.37 5.14 70297
  12.49 1.13 4.09
• UA 14318 -3.01 0.07 0.98 14318
  12.34 0.15 2.48
• UP 14829 3.54 0.28 1.18 14829
  13.23 -0.04 3.13

4
Airline Comparison, 27 March - 9 April, in TAMDAR
region, daytime only, p gt 500 mb, excluding two
bad TAMDAR aircraft

• Airline --------Temperature ----- ------Wind
  Speed --------
• N RUC-avg Bias Std N
  RUC-avg Bias Std
• AA 21188 1.77 -0.04 0.89 21182
  12.40 -0.08 2.49
• Canada 12636 -0.91 0.35 1.45 12633
  14.24 -0.32 4.08
• DL 14936 -0.88 0.21 1.21 13592
  15.66 0.42 4.01
• FX 33373 2.48 -0.09 1.18 33327
  13.14 -0.12 3.16
• NW 7262 -3.32 0.31 1.17 7262
  12.90 0.24 2.79
• TAMDAR 84999 1.12 -0.14 2.28 70024
  12.48 1.13 4.08
• UA 14318 -3.01 0.07 0.98 14318
  12.34 0.15 2.48
• UP 14829 3.54 0.28 1.18 14829
  13.23 -0.04 3.13

5
Airline Comparison, 27 March - 9 April, in TAMDAR
region, daytime only, p gt 500 mb, excluding six
bad TAMDAR (and Canadian--accidentally) aircraft

• Airline --------Temperature ----- ------Wind
  Speed --------
• N RUC-avg Bias Std N
  RUC-avg Bias Std
• AA 21188 1.77 -0.04 0.89 21182
  12.40 -0.08 2.49
• Canada 12409 -0.95 0.35 1.46 12406
  14.21 -0.31 4.07
• DL 14936 -0.88 0.21 1.21 13592
  15.66 0.42 4.01
• FX 33373 2.48 -0.09 1.18 33327
  13.14 -0.12 3.16
• NW 7262 -3.32 0.31 1.17 7262
  12.90 0.24 2.79
• TAMDAR 79047 1.17 -0.19 1.28 65048
  12.51 1.10 4.03
• UA 14318 -3.01 0.07 0.98 14318
  12.34 0.15 2.48
• UP 14829 3.54 0.28 1.18 14829
  13.23 -0.04 3.13

6
Airline Comparison, 27 March - 9 April, in TAMDAR
region, daytime only, p gt 500 mb, excluding five
TAMDAR aircraft with bad wind speeds (and five
Canadian--accidentally)

• Airline --------Temperature ----- ------Wind
  Speed --------
• N RUC-avg Bias Std N
  RUC-avg Bias Std
• AA 21188 1.77 -0.04 0.89 21182
  12.40 -0.08 2.49
• Canada 11822 -0.97 0.35 1.44 11822
  14.27 -0.29 4.08
• DL 14936 -0.88 0.21 1.21 13592
  15.66 0.42 4.01
• FX 33373 2.48 -0.09 1.18 33327
  13.14 -0.12 3.16
• NW 7262 -3.32 0.31 1.17 7262
  12.90 0.24 2.79
• TAMDAR 78977 1.13 -0.12 1.71 65101
  12.47 1.07 3.97
• UA 14318 -3.01 0.07 0.98 14318
  12.34 0.15 2.48
• UP 14829 3.54 0.28 1.18 14829
  13.23 -0.04 3.13

7
TAMDAR time series (Four-day periods) All TAMDAR
aircraft (T and W)

• Start Date --------Temperature -----
  ------Wind Speed --------
• N RUC-avg Bias Std N
  RUC-avg Bias Std
• 2005-02-18 26057 -10.94 -2.97 16.03 26057
  16.02 1.98 5.03
• 2005-02-22 26440 -11.79 -0.37 2.56 26440
  12.85 1.85 3.97
• 2005-02-26 24912 -12.03 -0.96 7.85 24912
  12.72 1.52 4.09
• 2005-03-02 28479 -11.18 -0.56 4.01 28479
  12.37 1.52 4.26
• 2005-03-06 28140 -10.54 -0.59 1.22 28140
  16.91 1.43 4.25
• 2005-03-10 27603 -12.64 -0.50 1.66 27603
  16.47 1.58 4.75
• 2005-03-14 34569 -11.93 -0.59 1.20 27955
  11.19 2.33 6.23
• 2005-03-18 31266 -8.42 -0.72 7.03 24761
  9.63 1.56 4.10
• 2005-03-22 35380 -5.01 -0.31 2.12 28282
  8.53 1.85 4.16
• 2005-03-26 34760 0.19 -0.04 3.39 28255
  10.15 1.39 3.95
• 2005-03-30 30101 -1.18 -1.04 8.05 24745
  15.14 1.03 4.37
• 2005-04-03 22110 1.44 -0.05 1.14 18182
  13.21 1.28 4.07
• 2005-04-07 29334 3.48 -0.09 1.28 23698
  9.99 1.12 3.84

8
TAMDAR time series (Four-day periods) All TAMDAR
aircraft (T and W)

• Start Date ---------RH --------------
• N RUC-avg Bias Std
• 2005-02-18 22534 53.57 2.94 21.08
• 2005-02-22 23246 55.61 3.87 18.33
• 2005-02-26 20583 55.84 1.86 16.60
• 2005-03-02 24238 49.85 2.42 16.31
• 2005-03-06 23665 49.30 2.52 16.75
• 2005-03-10 23528 54.97 4.91 17.35
• 2005-03-14 29650 50.26 6.70 15.95
• 2005-03-18 25934 58.26 3.87 15.52
• 2005-03-22 29576 59.22 -0.89 14.77
• 2005-03-26 29413 48.29 -1.73 15.97
• 2005-03-30 26201 48.76 3.03 15.01
• 2005-04-03 19188 44.86 -1.05 13.62
• 2005-04-07 24400 45.44 0.54 14.06

9
TAMDAR RH characteristics
10
RUC RH Characteristics
11
TAMDAR vs RUC RH Characteristics
12
TAMDAR compared with RUC 1h forecast

• Most of the following plots show
• TAMDAR measurements (x)
• RUC 1h forecast (y)
• 45 line is perfect agreement

13
RH RUC vs TAMDAR, 0030-0130 UTC, 27 March
through 9 April (n 3302)
14
Temperature RUC vs TAMDAR, 0030-0130 UTC, 27
March through 9 April. 2 bad aircraft removed
(n 3302)
15
Temperature bias (ob minus RUC) , 0030-0130 UTC,
27 March through 9 April, with 10 bad T aircraft
removed (some outliers remain)
16
Same data as previous, showing Temperature bias
not correlated with Observed Temperature
17
Temperature bias (ob minus RUC) , 0030-0130 UTC,
27 March through 9 April, with 10 bad T aircraft
removed. Ascents and Descents
18
Wind analysis

• It is helpful to divide winds into along-track
  and cross-track components
• The along-track component is similar to the
  tailwind. Air Speed errors primarily affect this
  component
• The cross-track component is affected by heading
  errors.

19
Along-track wind RUC vs TAMDAR, 0030-0130 UTC,
27 March through 9 April (n 3302)
20
Along-track wind RUC vs non-TAMDAR, p gt 500 mb,
0030-0130 UTC, 27 March through 9 April (n
12508)
21
Along-track wind RUC vs TAMDAR and non-TAMDAR,
p gt 500 mb, 0030-0130 UTC, 27 March - 9 April
22
Cross-track wind RUC vs TAMDAR, 0030-0130 UTC,
27 March through 9 April (n 3302)
23
Cross-track wind RUC vs TAMDAR and non-TAMDAR,
0030-0130 UTC, 27 March - 9 April
24
Wind Speed RUC vs TAMDAR, 0030-0130 UTC, 27 March
through 9 April
25
Wind Speed RUC vs TAMDAR and non-TAMDAR,
0030-0130 UTC, 27 March through 9 April