GSI InputOutput regional

1
GSI Input/Output(regional global)

• Russ Treadon
• NOAA/NWS/NCEP/EMC

GSI User Orientation 4-5 January 2005
Room 209, WWB Camp Springs, MD
2
Overview

• Input files
• observations, guess, fixed
• Output files
• Runtime info, innovation diagnostics
• analyses, Tb bias correction,
• Where to get input files
• Real-time cases
• Canned cases
• GSI run scripts

3
Input - Observations

• Useful web reference (Dennis Keyser)
• http//www.emc.ncep.noaa.gov/mmb/data_processing/d
  ata_processing/
• All observations packed in BUFR
• Observation types
• conventional data
• In-situ sondes, aircraft, buoys,
• Ex-situ cloud drift winds, SSM/I wind speeds,
  QuikSCAT winds, profilers,
• Brightness temperatures
• GOES-10, -12 sounder

single prepbufr file
4
Input - Observations

• Observation types
• POES Brightness temperatures (Tb)
• NOAA-14, -17 HIRS
• NOAA-14 MSU
• NOAA-15, -16 AMSU-A
• NOAA-15, -16, -17 AMSU-B
• Ozone
• NOAA-16 SBUV/2
• Rain rates
• SSM/I TRMM TMI
• Currently 1.0 superobs

Unique BUFR file for each sensor
5
Input - Observations

• Observation types
• Not-yet operational and/or experimental
• GPS local refractivity
• GOES imager Tb
• Radar radial winds
• Lidar line of sight winds (OSSE)

6
Input Observations file sizes

• Sizes of files vary from cycle to cycle, but
  numbers below are representative

-rw-r--r-- 1 wx20rt g01 4656456 Apr
27 2004 gdas1.t12z.1bamua.tm00.bufr_d -rw-r--r--
1 wx20rt g01 35321720 Apr 27 2004
gdas1.t12z.1bamub.tm00.bufr_d -rw-r--r-- 1
wx20rt g01 6123840 Apr 27 2004
gdas1.t12z.1bhrs2.tm00.bufr_d -rw-r--r-- 1
wx20rt g01 19572448 Apr 27 2004
gdas1.t12z.1bhrs3.tm00.bufr_d -rw-r--r-- 1
wx20rt g01 146920 Apr 27 2004
gdas1.t12z.1bmsu.tm00.bufr_d -rw-r--r-- 1
wx20rt g01 59551328 Jul 23 0851
gdas1.t12z.airs.tm00.bufr_d -rw-r--r-- 1 wx20rt
g01 322080 Apr 27 2004
gdas1.t12z.osbuv.tm00.bufr_d -rw-r--r-- 1
wx20rt g01 18480328 Apr 27 2004
gdas1.t12z.prepbufr.nr -rw-r--r-- 1 wx20rt
g01 2344160 Apr 27 2004
gdas1.t12z.spssmi.tm00.bufr_d -rw-r--r-- 1
wx20rt g01 323320 Apr 27 2004
gdas1.t12z.sptrmm.tm00.bufr_d
57 Mb for AQUA AIRS EOS_AMSUA
143 Kb for NOAA-14 MSU
7
Input - Guess

• Atmospheric/surface state
• Regional
• Currently uses forecast valid at analysis time
• Single atmospheric surface file (grid values)
• Binary (operational) or NetCDF format
• Global
• Currently uses 3, 6, 9-h forecasts spanning 3-h
  time window about analysis time
• Separate atmospheric (spectral coefficients)
  surface (grid values) files
• Binary format
• Option exists to read up to 100
  atmospheric/surface state guess files

8
Input - Guess

• Optional binary input files for
• Guess (increment) solution ? gesfile_in
• Usage controlled via namelist SETUP parameter
  iguess
• iguess -1 do not use guess solution
• iguess 0 only write guess solution
• iguess 1 read and write guess solution
• iguess 2 only read guess solution
• Model (guess) bias correction ? biascorin
• Usage controlled via namelist SETUP parameter
  biascor
• biascor ? 0.0 do not read/write/apply model bias
  correction file
• biascor gt 0.0 read/write/apply model bias
  correction file

9
Input - Guess

• Two Tb bias correction files
• Coefficients for predictor part of bias
  correction
• Updated within inner loop of analysis
• Slowly evolving angle dependent part of bias
• Updated in separate job step following analysis
  using Tb innovation file
• Slowly evolving 30-day running mean
• Both bias correction files are ASCII files

10
Input - Guess

• Tb bias correction files
• Predictive (gdas1.tCCz.abias)

1 14 1 0.000000 0.000000
0.000000 0.000000 0.000000 2 14 2
-5.581510 1.521482 0.000000 37.210154
12.670758 5 14 5 -23.015149 2.200222
0.000000 -273.712421 42.638886 19 14
19 0.000000 0.000000 0.000000
0.000000 0.000000 20 214 1 48.386058
35.554201 0.000000 0.806061 -157.873955
21 214 2 -5.533560 -2.859331 0.000000
105.463191 3.553266 102 315 13
-19.318128 -0.556426 -0.219018 -96.212604
16.200137 103 315 14 0.000000 0.000000
0.000000 0.000000 0.000000 104 315
15 43.108449 12.948671 101.922013
-8.368615 -235.572563 105 415 1 -25.048963
23.427696 0.000000 2.261089 -354.748356

Channel index
1) 0.01Mean
Channel number
Satellite/sensor id HIRS 14,15, MSU 214 AMSU-A
315, AMSU-B 415, GOES 60, 62
2) Path angle
3) Cloud liquid water (only AMSU-A)
4) Temperature lapse rate2
5) Temperature lapse rate
11
Input - Guess

• Tb bias correction files
• Angle dependent (gdas1.tCCz.satang)
• Running time mean of o-g at each scan position
• Units ? Kelvin

Channel index
Steps per scan line HIRS 56
MSU 11 AMSU-A 30 AMSU-B 90
channel 2 14 2 -0.287736E-01
-0.286 -0.262 -0.306 -0.298 -0.274 -0.303 -0.361
-0.321 -0.292 -0.344 -0.403 -0.380 -0.338
-0.376 -0.421 -0.382 -0.384 -0.414 -0.435 -0.403
-0.391 -0.431 -0.439 -0.390 -0.387 -0.436
-0.441 -0.407 -0.399 -0.447 -0.444 -0.386
-0.401 -0.438 -0.433 -0.386 -0.383 -0.435 -0.416
-0.384 -0.369 -0.408 -0.412 -0.366 -0.331
-0.378 -0.380 -0.342 -0.300 -0.345 -0.359
-0.305 -0.329 -0.391 -0.409 -0.420 -1.287 -1.287
-1.287 -1.287 -1.287 -1.287 -1.287 -1.287
-1.287 -1.287 -1.287 -1.287 -1.287 -1.287
-1.287 -1.287 -1.287 -1.287 -1.287 -1.287 -1.287
-1.287 -1.287 -1.287 -1.287 -1.287 -1.287
-1.287 -1.287 -1.287 -1.287 -1.287 -1.287
-1.287 channel 3 14 3 -0.133031E-01
-1.040 -0.998 -0.996 -0.948 -0.892 -0.851
-0.861 -0.832 -0.778 -0.738 -0.750 -0.777
-0.689 -0.647 -0.670 -0.679 -0.662 -0.619 -0.631
-0.621
Simply pad out remainder of array
12
Input Guess files sizes

• Tb bias correction files
• Regional guess (sizes depend on domain,
  resolution)
• Global guess (T254L64 below T382L64 220 Mb)

-rw-r--r-- 1 wx20rt g01 37468 Apr
27 2004 gdas1.t06z.abias -rw-r--r-- 1 wx20rt
g01 353481 Apr 27 2004 gdas1.t06z.satang
-rwxr-xr-x 1 wx20rt g01 267241800 Sep
13 1420 wrfinput_d01_nmm_binary -rwxr-xr-x 1
wx20rt g01 1077518640 Sep 13 1421
wrfinput_d01_nmm_netcdf -rwxr-xr-x 1 wx20rt
g01 191674028 Sep 13 1418
wrfinput_west_mass_d01_bi -rwxr-xr-x 1 wx20rt
g01 191260944 Sep 13 1419
wrfinput_d01_mass_cent
-rw-r--r-- 1 wx20rt g01 30671856 Apr
27 2004 gdas1.t06z.bf03 -rw-r--r-- 1 wx20rt
g01 30671856 Apr 27 2004
gdas1.t06z.bf06 -rw-r--r-- 1 wx20rt g01
30671856 Apr 27 2004 gdas1.t06z.bf09 -rw-r--r--
1 wx20rt g01 100796456 Apr 27 2004
gdas1.t12z.sgesprep -rw-r--r-- 1 wx20rt g01
100796456 Apr 27 2004 gdas1.t12z.sgm3prep -rw
-r--r-- 1 wx20rt g01 100796456 Apr 27
2004 gdas1.t12z.sgp3prep
13
Input - Fixed

• Background error
• Regional
• regional_berror.f77
• Contains default statistics for any regional
  domain
• Statistics based on GFS (NCEP global model)
• Global (sigma)
• global_berror.llevs.ylats.sig.f77
• levs 28 or 64
• lats 96 or 258 (corresponds to T62 and T254)
• All background files are binary files

14
Input - Fixed

• Community Radiative Transfer Model (CRTM)
• Binary files, one each for spectral and
  transmittance coefficients
• global_spectral_coefs.f77
• global_transmittance_coefs.f77
• For more information see
• http//cimss.ssec.wisc.edu/paulv/Fortran90/CRTM/P
  rototype/
• InfraRed Sea Surface Emissivity (IRSSE) model
• Single binary coefficient file
• global_emissivity_coefs.f77
• For more information see
• http//cimss.ssec.wisc.edu/paulv/Fortran90/Emissi
  vity/Sensor_Emissivity_Model/

15
Input - Fixed

• Observation usage/specification files
• Separate ASCII file for Tb, ozone, rain rates
• global_satinfo.txt
• global_ozinfo.txt
• global_pcpinfo.txt
• Each file specifies
• Data usage (off, monitor, or assimilate)
• Observation error
• Instrument/observation characteristics
  (microwave/IR, etc.)

16
Input - Fixed

• Example global_satinfo.txt

Satellite/sensor id HIRS 14,15, MSU 214 AMSU-A
315, AMSU-B 415, GOES 60, 62
14 1 0 -1 19 0.1000000000E05
0.0000000000E00 14 2 0 1 19
0.5100000000E00 0.0000000000E00 14 3
0 1 19 0.4600000000E00 0.0000000000E00
14 4 0 1 19 0.3500000000E00
0.0000000000E00 14 5 0 1 19
0.3550000000E00 0.0000000000E00 60
13 0 1 7 0.4000000000E00
0.0000000000E00 60 14 0 1 7
0.3000000000E00 0.0000000000E00 60 15
0 1 7 0.9700000000E00 0.0000000000E00
60 16 0 -1 7 0.5400000000E00
0.0000000000E00 60 17 0 -1 6
0.1000000000E05 0.0000000000E00 60 18
0 -1 3 0.1000000000E05 0.0000000000E00
260 2 0 -1 6 0.2000000000E01
0.0000000000E00 260 3 0 -1 8
0.1400000000E01 0.0000000000E00 260 4
0 -1 15 0.3000000000E01 0.0000000000E00
260 5 0 -1 17 0.3000000000E01
0.0000000000E00 62 1 0 1 19
0.4500000000E00 0.0000000000E00 62 2
0 1 19 0.3600000000E00 0.0000000000E00
317 11 1 1 0 0.7000000000E00
0.1000000000E01 317 12 1 1 0
0.1100000000E01 0.1000000000E01 317 13
1 1 0 0.2100000000E01 0.1000000000E01
317 14 1 -1 0 0.1000000000E05
0.1000000000E01 317 15 1 1 0
0.9000000000E01 0.0000000000E00 417 1
1 1 0 0.5000000000E01 0.0000000000E00
417 2 1 1 0 0.3750000000E01
0.0000000000E00 417 3 1 1 0
0.3500000000E01 0.0000000000E00 417 4
1 1 0 0.3000000000E01 0.0000000000E00
417 5 1 1 0 0.2800000000E01
0.0000000000E00
Channel number
Observation error (units Kelvin)
IR/?-wave flag 0IR, 1?-wave
Polarization 0 none or vertical 1
horizontal (units Kelvin)
Data usage flag -2 dont use -1 monitor,
dont assimilate 1 assimilate
17
Input - Fixed

• Angle dependent bias correction
• Tb angle dependent bias correction file
• global_satangbias.txt
• Backup to time evolving file
• Extra fixed files
• Conventional observation error specifications
• nam_errtable.r3dv
• Only used for regional runs
• Usage is temporary ? observation errors will be
  encoded in regional prepbufr files later in 2005
• BUFR table specs
• prepobs_prep.bufrtable
• Only needed when running in single observation
  mode
• set oneobtest .true. in namelist SETUP to turn
  single observation mode on

18
Input - Fixed

• Fixed files available from GSI web site

19
Input Fixed file sizes

• Sizes range from 1.7 Kb to 12.2 Mb

-rw-r--r-- 1 wx20rt g01 12817456 Nov
02 1245 global_berror.l64y258.sig.f77 -rw-r--r--
1 wx20rt g01 4277776 Nov 02 1245
global_berror.l64y96.sig.f77 -rw-r--r-- 1
wx20rt g01 867832 Oct 21 1359
global_emissivity_coefs.f77 -rwxr-xr-x 1 wx20rt
g01 3763 May 04 2004
global_ozinfo.txt -rwxr-xr-x 1 wx20rt g01
1733 Dec 07 1405 global_pcpinfo.txt -rwxr-
xr-x 1 wx20rt g01 353481 Dec 07
1406 global_satangbias.txt -rwxr-xr-x 1 wx20rt
g01 31059 Dec 07 1406
global_satinfo.txt -rw-r--r-- 1 wx20rt g01
81000 Oct 14 1417 global_spectral_coefs.f7
7 -rw-r--r-- 1 wx20rt g01 1011900 Oct
14 1417 global_transmittance_coefs.f77 -rwxr-xr-x
1 wx20rt g01 493400 Jan 04 1606
nam_errtable.r3dv -rwxr-xr-x 1 wx20rt g01
57915 Dec 07 1405 prepobs_prep.bufrtable -r
w-r--r-- 1 wx20rt g01 3653984 Jun 24
2004 regional_berror.f77
20
Output runtime

• Scratch files
• Observation specific obsfil1000, obsfil1001,
• Created by read_.f90 routines
• Read by obs_para.f90
• Distributed observations obs_s1000, obs_s1001,
• Created by obs_para.f90 (disobs)
• Read by setuprhsall.f90
• Inner loop innovation files obs_o1000,obs_o1001,
  
• Created by setuppcp.f90 and setuprad.f90
• Read by makeobs from pcgsoi.f90

21
Output runtime

• Fortran unit 6 ? stdout
• Echoes namelist input (gsimain.F90)

0 0 0 . . . . . . . .
. . . . . . . . . . . .
0 PROGRAM GLOBAL_GSI HAS BEGUN. COMPILED
1999232.55 ORG NPA23 0 STARTING
DATE-TIME JAN 03,2005 100427.720 3 MON
2453374 0 0 0 calling gsisub with
following input parameters 0 0 0
SETUP 0 AS0.550000000000000044,
0.550000000000000044, 0.849999999999999978,
0 0.949999999999999956, 1.19999999999999996,
1.19999999999999996, 0 0.599999999999999978,
0.599999999999999978, 0.599999999999999978,
0 0.599999999999999978, VS0.599999999999999978,
BW0.000000000000000000E00, 0
HZSCL0.750000000000000000, 1.50000000000000000,
3.00000000000000000, HSWGT 0
0.333333333333333315, 0.333333333333333315,
0.333333333333333315, ERMAXT 0
5.59999999999999964, ERMAXW6.09999999999999964,
ERMAXP3.00000000000000000, 0
ERMAXQ100.000000000000000, ERMAXPW8.000000000000
00000, ERMAXRW 0 10.0000000000000000,
ERMAXDW10.0000000000000000, ERMAXGPS_REF 0
10.0000000000000000, ERMAXSRW10.0000000000000000,
ERMAXSST2.0000000000000000
22
Output runtime

• Fortran unit 6 ? stdout
• Number of observations read / retained for each
  of the ndat data files (read_.f90 routines)

25 READ_RADAR read EOF for infileradarbufr
unit 10 jsatid 0 nread 0
ithin-9 rmesh-99.999 ndata 0 27
READ_GPS_REF read EOF for infilegpsref
unit 10 jsatid 0 nread 0 ithin-9
rmesh-99.999 ndata 0 15 READ_GOESIMG
read EOF for infilegoesimg unit 10
jsatid 10 nread 0 ithin 3
rmesh180.000 ndata 0 16 READ_GOESIMG
read EOF for infilegoesimg unit 10
jsatid 12 nread 0 ithin 3
rmesh180.000 ndata 0 17 READ_AIRS
read EOF for infile AIRS unit 10
jsatid 49 nread 0 ithin 3
rmesh180.000 ndata 0 3 READ_BUFRTOVS
read EOF for infilemsubufr unit 15
jsatid 14 nread 9478 ithin 1
rmesh145.000 ndata 6633 18 READ_AIRS
read EOF for infile AMSU unit 10
jsatid 49 nread 0 ithin 1
rmesh145.000 ndata 0 12 READ_BUFRTOVS
read EOF for infileamsuabufr unit 15
jsatid 17 nread 0 ithin 1
rmesh145.000 ndata 0 11 READ_OZONE
read EOF for infilesbuvbufr unit 10
jsatid 16 nread 954 ithin-9
rmesh-99.999 ndata 308 0 READ_BUFRTOVS
read EOF for infileamsuabufr unit 15
jsatid 15 nread 80790 ithin 1
rmesh145.000 ndata 11904 7 READ_PCP
read EOF for infiletmi unit 10
jsatid211 nread 10600 ithin-9
rmesh-99.999 ndata 10600 24 READ_LIDAR
read EOF for infiledw unit 10
jsatid 0 nread 0 ithin-9
rmesh-99.999 ndata 0 6 READ_PCP
read EOF for infilessmi unit 10
jsatid264 nread 30652 ithin-9
rmesh-99.999 ndata 30652 8 READ_BUFRTOVS
read EOF for infileamsuabufr unit 15
jsatid 16 nread 80850 ithin 1
rmesh145.000 ndata 12281 4 READ_GOESNDR
read EOF for infileprepqc unit 10
jsatid 10 nread 7913 ithin 3
rmesh180.000 ndata 497 5 READ_GOESNDR
read EOF for infileprepqc unit 10
jsatid 12 nread 12740 ithin 3
rmesh180.000 ndata 464 2 READ_BUFRTOVS
read EOF for infilehirs2bufr unit 15
jsatid 14 nread 178655 ithin 3
rmesh180.000 ndata 8184 19 READ_PREPBUFR
read EOF for infilet unit 10
jsatid 0 nread 246719 ithin-9
rmesh-99.999 ndata 22565 21 READ_PREPBUFR
read EOF for infileps unit 10
jsatid 0 nread 246719 ithin-9
rmesh-99.999 ndata 44087 20 READ_PREPBUFR
read EOF for infileuv unit 10
jsatid 0 nread 246719 ithin-9
rmesh-99.999 ndata 96618 26 READ_PREPBUFR
read EOF for infilespd unit 10
jsatid 0 nread 246719 ithin-9
rmesh-99.999 ndata 16932
23
Output runtime

• Fortran unit 6 ? stdout
• Data counts per MPI task for each of the ndat
  data files (obs_para.f90)

0OBS_PARA disobs amsua 27
304 31 0 99 192
0 255 172 34 0
245 363 30 232
332 34 152 205 205
404 0 0 431 293
352 8 420 35 0
236 584 332 0 0
396 566 0 482
493 0 620 440 264
178 0 0 112 443
358 662 0 745 108
506 0OBS_PARA disobs amsub 14
118 15 0 40 69
0 97 63 15 0
87 135 18 87
125 15 61 77 77
152 0 0 163
104 132 6 164 17
0 93 227 120 0 0
150 211 0 187
184 0 237 169 99
69 0 0 47
169 132 255 0 284
44 182 0OBS_PARA disobs hirs/2
5 221 4 0 132
131 118 150 140 190 0
157 19 68
144 247 129 112 156
128 182 0 0 288
186 253 0 281 286
316 0 415 0 0 0
241 386 0
31 368 85 448 453
61 169 0 0 224
397 91 408 0 337
0 325
24
Output runtime

• Fortran unit 6 ? stdout
• Information about
• guess files and background error
• CRTM IRSSE initializations
• Written from routines called from glbsoi.f90

47 READ_FILES sigma guess file, nming2
3.00000000000000000 6 4 15 2004 13825980 47
READ_FILES sigma guess file, nming2
6.00000000000000000 6 4 15 2004 13826160 47
READ_FILES sigma guess file, nming2
9.00000000000000000 6 4 15 2004 13826340 47
READ_FILES surface guess file, nming2
3.00000000000000000 6 4 15 2004 13825980 47
READ_FILES surface guess file, nming2
6.00000000000000000 6 4 15 2004 13826160 47
READ_FILES surface guess file, nming2
9.00000000000000000 6 4 15 2004 13826340 0
READ_FILES sigma fcst files used in analysis
3 6 9 -3.00000000000000000 0.000000000000000000E
00 3.00000000000000000 2 0 READ_FILES
surface fcst files used in analysis 3 6 9
-3.00000000000000000 0.000000000000000000E00
3.00000000000000000 2 0 Read_TauCoeff_Binary(INF
ORMATION) FILE transmittance_coefficients
0 TauCoeff RELEASE.VERSION 5.03 N_ORDERS10
N_PREDICTORS 6 N_ABSORBERS 3 N_CHANNELS 493
N_SENSORS21 0 Read_SpcCoeff_Binary(INFORMATION)
FILE spectral_coefficients 0 SpcCoeff
RELEASE.VERSION 4.02 N_CHANNELS 493
N_SENSORS21 0 Read_EmisCoeff_Binary(INFORMATION
) FILE emissivity_coefficients 0 EmisCoeff
RELEASE.VERSION 3.01 N_INTCOEFFS 4
N_THETACOEFFS 5 N_CHANNELS 410
N_WIND_SPEEDS13 N_SENSORS12 0 guess sigma
coefficients read in, jcap,nsig 254 64 0
hour,idate 3.0 6 4 15 2004 0
guess sigma coefficients read in, jcap,nsig
254 64 0 hour,idate 6.0 6 4
15 2004 0 guess sigma coefficients read in,
jcap,nsig 254 64 0 hour,idate 9.0
6 4 15 2004 0 RDGESFC fhour 3.
idate 6 4 15 2004 0 RDGESFC fhour
6. idate 6 4 15 2004 0 RDGESFC
fhour 9. idate 6 4 15 2004 0
PREWGT read error amplitudes.
mype,nsigstat,mlat 0 64 258
25
Output runtime

• Fortran unit 6 ? stdout
• Information about Tb, ozone, and precipitation
  diagnostic files (setuprad.f90,
  setuppcp.f90,setupoz.f90)

0 SETUPRAD write header record for amsua
15 15 1 10 6 0 amsua.015_01.0000 0
idate 2004041512 2004 4 15 12 0 0 SETUPRAD
write header record for amsub 15 5 1 10 6 0
amsub.015_01.0000 0 idate 2004041512 2004
4 15 12 0 0 SETUPRAD write header record
for hirs/2 14 19 1 10 6 0 hirs2.014_01.0000
0 idate 2004041512 2004 4 15 12 0 0
SETUPPCP write header record for mype 0 8 23
pcp_ssmi.264_01.000 3 SETUPRAD write header
record for goes 10 18 1 10 6 0
goes.010_01.0003 3 idate 2004041512 2004
4 15 12 0 0 SETUPRAD write header record
for amsua 16 15 1 10 6 0 amsua.016_01.0000
0 idate 2004041512 2004 4 15 12 0 1
SETUPRAD write header record for msu 14
4 1 10 6 0 msu.014_01.0001 1 idate
2004041512 2004 4 15 12 0 0 SETUPRAD write
header record for amsub 16 5 1 10 6 0
amsub.016_01.0000 0 idate 2004041512 2004
4 15 12 0 1 SETUPRAD write header record
for goes 12 18 1 10 6 0 goes.012_01.0001
1 idate 2004041512 2004 4 15 12 0 0
SETUPRAD write header record for hirs/3 16
19 1 10 6 0 hirs3.016_01.0000 0 idate
2004041512 2004 4 15 12 0 0 SETUPOZ write
header record for sbuv2 16 13 1 4 0
sbuv2.016_01.0000 0 idate 2004041512 2004
4 15 12 0
26
Output runtime

• Fortran unit 6 ? stdout
• Indication of observations tossed by gross check
  (output not always present)
• Written from sprf90, setupoz.f90

1 SPRUV wind dim,num 6425 6424 1 SPRQ
q dim,num 817 816 23 SPRUV wind dim,num
3859 3858 28 SPRUV wind dim,num 1021 1020
42 SETUPOZ reset O3 varinv3
0.000000000000000000E00 42 SETUPOZ reset O3
varinv3 0.000000000000000000E00 42 SPRUV
wind dim,num 1379 1378 21 SPRUV wind
dim,num 528 527 17 SPRUV wind dim,num 608
607 46 SPRUV wind dim,num 2412 2410
27
Output runtime

• Fortran unit 6 ? stdout
• Inner loop diagnostics (pcgsoi.f90)

0 penalty,grad ,a,b 1 0 0.40783876650230673
8E06 0.672881988912119158E07 0.49096989700685034
9E-02 0.000000000000000000E00 0 pnorm,gnorm,
step? 1 0 0.100000000000000000E01
0.100000000000000000E01 good 0 penalty,grad
,a,b 1 1 0.374801881376709847E06
0.755374881157548819E07 0.227556046928344222E-02
0.112259624280766102E01 0 pnorm,gnorm, step?
1 1 0.918995230863101309E00 0.11225963744085347
7E01 good 0 penalty,grad ,a,b 1 2
0.357612840684401395E06 0.871533453814106435E07
0.235114668154543871E-02 0.115376428822967725E01
0 pnorm,gnorm, step? 1 2 0.87684857364430735
0E00 0.129522482125455118E01 good 0
penalty,grad ,a,b 1 3 0.337121786602816952E0
6 0.464924013309245184E07 0.256797750068424660E-0
2 0.533439886139196684E00 0 pnorm,gnorm, step?
1 3 0.826605546829276672E00
0.690944357213231886E00 good 0 penalty,grad
,a,b 1 4 0.325182547220774868E06
0.441239588677344471E07 0.339615296439479486E-02
0.949040370883298290E00 0 pnorm,gnorm, step?
1 4 0.797331136541027274E00 0.65574587512844240
1E00 good 0 penalty,grad ,a,b 1 100
0.214520795512139070E06 0.835454317353507747E02
0.214850406099953211E-02 0.183295219054996061E01
0 pnorm,gnorm, step? 1 100 0.52599412594321326
4E00 0.124160600390601504E-04 good 1 SPRQ q
dim,num 817 816 0 penalty,grad ,a,b 2 0
0.220794784612346761E06 0.109404036458312243E06
0.359423683721068511E-02 0.000000000000000000E00
0 pnorm,gnorm, step? 2 0 0.54137762946352463
4E00 0.162590228689567136E-01 good 0
penalty,grad ,a,b 2 1 0.220406005242019077E0
6 0.113825833063069047E06 0.208475624114485159E-0
2 0.104042397149473098E01 0 pnorm,gnorm, step?
2 1 0.540424362137659764E00
0.169161658268037127E-01 good
Step size, ?
? parameter
Inner loop count
1st line current magnitude of gradient 2nd
line current mag_grad / initial mag_grad
Outer loop count
1st line current total penalty 2nd line
current total penalty / initial total penalty
28
Output runtime

• Fortran unit 6 ? stdout
• Write analysis and resource statistics
  (write_all.f90)

0 WRSIGA sigma analysis written 254
64 0.0 12 4 15 2004 0 0 0
ENDING DATE-TIME JAN 03,2005 101809.096
3 MON 2453374 0 PROGRAM GLOBAL_GSI HAS
ENDED. IBM RS/6000 SP 0 . . . . .
. . . . . . . . . . . . .
. . 0RESOURCE
STATISTICS 0
0The total amount of wall time
821.378341 0The total amount of time
in user mode 747.630000 0The
total amount of time in sys mode
8.050000 0The maximum resident set size
(KB) 500312 0Average
shared memory use in text segment (KBsec)
1517874
29
Output fort.2

• Runtime output (ASCII) files containing
  innovation statistics
• Written by statsconv.f90, statsoz.f90,
  statspcp.f90 statsrad.f90
• Generated at start of each outer loop (o-gi)
• Optionally generated following last outer loop
  (o-a)

-rw-r--r-- staff 2967 Jan 03 1017
fort.201 ? surface pressure -rw-r--r-- staff
60297 Jan 03 1017 fort.202 ? winds -rw-r--r--
staff 29385 Jan 03 1017 fort.203 ?
temperature -rw-r--r-- staff 27192 Jan 03
1017 fort.204 ? moisture -rw-r--r-- staff
1788 Jan 03 1017 fort.205 ? precipitable
water -rw-r--r-- staff 12111 Jan 03 1017
fort.206 ? ozone -rw-r--r-- staff 121108
Jan 03 1017 fort.207 ? brightness
temperatures -rw-r--r-- staff 9201 Jan 03
1017 fort.208 ? precipitation rates -rw-r--r--
staff 22224 Jan 03 1017 fort.209 ? radar
winds -rw-r--r-- staff 21828 Jan 03 1017
fort.210 ? lidar winds -rw-r--r-- staff
26805 Jan 03 1017 fort.211 ? radar superobs
winds -rw-r--r-- staff 21861 Jan 03 1017
fort.212 ? gps local refractivity -rw-r--r--
staff 1743 Jan 03 1017 fort.213 ? sst
30
Output fort.204 example

• Example Moisture innovation statistics

OUTER ITERATION jiter 1 current fit of q
data, units in per-cent of guess q-sat
ptop 900.0 800.0 600.0
450.0 225.0 0.0 it obs type pbot
1000.0 900.0 800.0 550.0 275.0
2000.0 ----------------------------------------
---------------------------------------------
o-g 01 q 120 count 1260 1361
2349 1457 0 9432 o-g 01 q
120 bias -3.4636 -3.3771 -4.4515 -2.9063
0.0000 -3.4897 o-g 01 q 120 rms
14.8684 15.8916 20.1319 18.1710 0.0000
17.8711 o-g 01 q 120 cpen 0.3861
0.4809 0.8383 0.6525 0.0000 0.6058
o-g 01 q 120 qcpen 0.3861 0.4809
0.8383 0.6525 0.0000 0.6058 o-g 01
q 180 count 32 0 0
0 0 944 o-g 01 q 180 bias
4.7633 0.0000 0.0000 0.0000 0.0000
4.6428 o-g 01 q 180 rms 11.8361
0.0000 0.0000 0.0000 0.0000 12.3543
o-g 01 q 180 cpen 0.2606 0.0000
0.0000 0.0000 0.0000 0.2773 o-g 01
q 180 qcpen 0.2606 0.0000 0.0000
0.0000 0.0000 0.2773 o-g 01 q 182
count 0 0 0 0
0 2 o-g 01 q 182 bias 0.0000
0.0000 0.0000 0.0000 0.0000
7.2844 o-g 01 q 182 rms 0.0000
0.0000 0.0000 0.0000 0.0000 7.5754
o-g 01 q 182 cpen 0.0000 0.0000
0.0000 0.0000 0.0000 0.1094 o-g 01
q 182 qcpen 0.0000 0.0000 0.0000
0.0000 0.0000 0.1094 o-g 01 q all
count 1292 1361 2349 1457
0 10378 o-g 01 q all bias -3.2599
-3.3771 -4.4515 -2.9063 0.0000
-2.7479 o-g 01 q all rms 14.8008
15.8916 20.1319 18.1710 0.0000 17.4401
o-g 01 q all cpen 0.3830 0.4809
0.8383 0.6525 0.0000 0.5758 o-g 01
q all qcpen 0.3830 0.4809 0.8383
0.6525 0.0000 0.5758 num(q) 1797 at
lev 1 pen,qcpen,cpen,cqcpen 356.00
356.00 0.19811 0.19811 num(q)
147 at lev 2 pen,qcpen,cpen,cqcpen 52.681
52.681 0.35838 0.35838 num(q)
119 at lev 3 pen,qcpen,cpen,cqcpen 44.704
44.704 0.37566 0.37566 num(q)
88 at lev 4 pen,qcpen,cpen,cqcpen 33.295
33.295 0.37835 0.37835 total
10378 for type q pen 0.597563622782382754E04
qcpen 5975.64 r 0.575798 qcr
0.575798 (scaled as precent of guess
specific humidity) gross error check for q
for check, obs error bounded by 10.0000
100.000 for check, max ratio residual/ob
error 10.0000 number obs that failed gross
test 0 number obs that failed nonlin qc
test 0 grsmlt 5.0 number of bad q
obs 1. number of q obs 10379 number
extrapolated above top sigma layer 0
number extrapolated below bottom sigma layer
574
Observation count, bias, and rms as a function
of a) obs type b) pressure layer
Penalty info as a function of model level
Gross check and other qc info
31
Output fort.207 example

• Various pieces of information about use of Tb
  data
• contents of satinfo file
• coefficients for predictive part of bias
  correction
• total penalty and data counts (all data counts
  for qc branches)
• channel-by-channel listing of various quantities
• columns are (1) channel index, (2) channel
  number, (3) satellite id, (4) number of obs used,
  (5) number of obs tossed, (5) satinfo obs error,
  (7) O-G before bias correction, (8) O-G after
  bias correction, (9) penalty contribution, (10)
  O-G rmsd, and (11) O-G standard deviation

sat type num numw ich1 415 amsub
4710 4575 10 penalty iland
isnoice ireduce icoast itopo
ivarl 3404.64931183 922 781 0
11 407 765
106 2 415 2607 191 3.750
0.9149322 0.1279916 0.1909198 2.5527126
2.5495019 107 3 415 2607 108 3.500
1.2241415 0.1709235 0.2860755 2.4511203
2.4451536 108 4 415 2607 119 3.200
3.7832747 0.2496986 0.3214471 2.3754613
2.3623013 109 5 415 2607 143 2.500
0.7462531 0.2157980 0.2968875 1.8690994
1.8566001 110 1 16 8090 254 -10000.000
-4.7966760 -0.0388463 0.0000000 1.9016271
1.9012303 111 2 16 8344 0 -0.700
0.4707935 0.0031964 0.0000000 0.6414647
0.6414567
32
Output fort.220

• More extensive inner loop diagnostics
  (stpcalc.f90, stpcalc_qc.f90)
• See comments in stpcalc.f90 to link J listing to
  specific cost function terms
• To see a and b terms used to in step size
  calculation, turn on write statements in
  stpcalc.f90 (stpcalc_qc.f90)

backgrnd Tb_bc pcp_bc ps uv tb t
pw q oz lidar radar supr_radr
sst gps wind spd pcp qlt0 qgtqs
J 0.000000000000000000E00 0.000000000000000000E
00 0.000000000000000000E00
0.217678418277670680E05 0.160427162891340384E06
0.118970856077642005E06 0.452709247744691529E
05 0.000000000000000000E00 0.597563622782382754E
04 0.306148750263779148E05
0.000000000000000000E00 0.000000000000000000E00
0.000000000000000000E00 0.000000000000000000E
00 0.000000000000000000E00
0.130015918606215164E05 0.142153275001055590E03
0.115637795330488443E05 0.103945008214892468E
03 penalty,grad ,a,b 1 0
0.407838766502306738E06 0.672881988912119158E07
0.490969897006850349E-02 0.000000000000000000E00
pnorm,gnorm, step? 1 0 0.100000000000000000E
01 0.100000000000000000E01 good linear, 1st,
2nd a0.483507099356410633E-02 0.49097751799507677
3E-02 0.490969897006850349E-02 J
0.128934808137721319E03 0.332643640827723672E02
0.000000000000000000E00 0.169968224622424823E
05 0.150207518989887409E06 0.107255622726162779E
06 0.439980796344248665E05
0.000000000000000000E00 0.591414323091695587E04
0.265308893409256452E05 0.000000000000000000E
00 0.000000000000000000E00
0.000000000000000000E00 0.000000000000000000E00
0.000000000000000000E00 0.119433588430429008E
05 0.142312198926850897E03 0.115477311393295495E
05 0.103203638629788969E03 penalty,grad
,a,b 1 1 0.374801881376709847E06
0.755374881157548819E07 0.227556046928344222E-02
0.112259624280766102E01 pnorm,gnorm, step? 1
1 0.918995230863101309E00 0.112259637440853477E
01 good
33
Output diagnostic files

• O-G, O-A innovation files
• binary format
• generation controlled via namelist variables
  diag_conv, diag_ozone, diag_pcp, diag_rad, and
  write_diag
• general contents include
• observation type, longitude, latitude, pressure
  (if applicable), observation error, time
  (relative to analysis), observation value,
  simulated value
• observation specific contents include, for
  example
• moisture guess saturation specific humidity
• winds 10-m reduction factor
• Tb scan angle properties, surface emissivity,
  etc
• ...

34
Output diagnostic files

• O-G, O-A innovation files (continued)
• Each MPI task writes unique diagnostic file for
  requested data type.
• Local filename has the form
• OBS_JITER.0000, OBS_JITER.0001, , where
• OBS conv, sbuv2, pcp_tmi, pcp_ssmi, amsua_015,
  amsua_016, amsua_017, amsub_015, hirs2_014,
  hirs3_017, etc.
• JITER 01, 02,
• NOTE If O-A statistics requested, they will be
  written to files with JITER MITER 1
• For file structure and contents see setupf90
  routines
• Following GSI, run script concatenates diagnostic
  files to create single file for each OBS_JITER
  combination.

35
Output Atmosphere/Surface

• Analysis
• Atmospheric
• Global analyze ?, ?, Tv, q/qsg, rcld, rlyr_oz
  (model ?, ??V)
• Regional analyze ?, ?, Tv, q /qsg
  (model u,v)
• Surface
• Update Tskin via forcing from Tb observations
• Working on SST and more complete surface analysis
• Files
• Regional
• Single file
• Analysis fields written back into guess file ?
  wrf_inout
• Global
• Separate atmospheric and surface files
• Analysis files are distinct from guess files ?
  siganl, sfcanl.gsi

36
Output Tb,

• Predictive part of Tb bias correction
• Coefficients updated during inner loop of
  analysis
• satbias_out (in local working directory)
• Innovations diagnostics
• Unique file for
• Each Tb satellite/sensor (e.g.,
  diag_amsua.015.2004041512.Z)
• Each rain rate observation type (e.g.,
  diag_pcp_tmi.211.20041512.Z)
• Each ozone satellite/sensor (e.g.,
  diag_sbuv2.016.2004041512.Z)
• Conventional data lumped together in single file
  (e.g., diag_conv.20041512.Z)
• Optional output files for
• Guess (increment) solution ? local file
  gesfile_out
• Model bias correction ? local file biascorout

37
Where to find input files

• NCEP public server
• Web link through EMC web page
• http//www.emc.ncep.noaa.gov/data/
• Direct web link
• ftp//ftpprd.ncep.noaa.gov/pub/data/nccf/com/
• Anonymous ftp to ftpprd.ncep.noaa.gov

38
Where to find input files

• Upcoming Data Set Name Changes
• Effective 25 January 2005
• Global AVN/FNL ? GFS/GDAS
• Regional ETA/EDAS ? NAM/NDAS
• For more information go to
• General info under Production Changes _at_
• http//www.nco.ncep.noaa.gov/pmb/docs/ccs_transiti
  on/
• FTP server specific information
• http//www.nco.ncep.noaa.gov/pmb/docs/ccs_transiti
  on/ftpsrv_rename.html

39
Where to find Global files

• Observations
• Prefix gdas1.tCCz.
• Suffix .tm00.bufr_d
• Types
• Conventional prepbufr.nr
• AMSU-A 1bamua
• AMSU-B 1bamub
• HIRS2,3 1bhrs2,3
• MSU 1bmsu
• Ozone osbuv
• SSM/I rain rates spssmi
• TMI rain rates sptrmm
• nr indicates file with restricted data removed.
  For more information on restricted data see
  http//www.nco.ncep.noaa.gov/dmqab/restricted_data
  _pmb/

POES 1B
Surface guess
Ozone
40
Where to find Global files

• Guess
• Prefix gdas1.tCC-06z.
• Types
• Atmosphere
• sf03, sf06, sf09
• Surface
• bf03, bf06, bf09
• Tb bias correction files are not posted on FTP
  server
• Coefficients abias
• Angle dependent satang
• Analysis
• Prefix gdas1.tCCz.
• Atmosphere
• sanl
• Surface
• Not posted on FTP server
• sfcanl
• Tb bias correction files
• Not posted on FTP server

prepbufr
Atmosphere analysis
Atmosphere guess
Rain rates
41
Where to find Regional files

• NAM nmm and mass core guess files are not yet
  placed on the NCEP FTP server
• May be placed there once regional GSI becomes
  operational
• Make use of canned cases

42
Canned cases

• I/O for arbitrarily chosen global and regional
  cases are available through the GSI web site
• http//www.emc.ncep.noaa.gov/gmb/treadon/gsi/

43
GSI run scripts

• GSI run scripts bring I/O pieces together
• Available from GSI web site
• rungsi_global.sh
• rungsi_regional_nmm_binary.sh
• rungsi_regional_nmm_netcdf.sh
• rungsi_regional_mass_binary.sh
• rungsi_regional_mass_netcdf.sh
• Scripts make use of canned cases