Observing System Monitoring Center (OSMC) Status Update

1
Observing System Monitoring Center (OSMC)Status
Update

• Office of Climate Observation
• May 2006
• Kevin OBrien
• Steve Hankin PMEL (co-PI)
• Kevin Kern NDBC (co-PI)
• Ted Habermann NGDC (co-PI)

2
to provide a system view of global ocean
climate observations
3
A partnership

• PMELUser interface logic tools
• NDBCData assembly operations
• NGDC
• Database GIS consulting

4
OSMC (meta)database

• What is the climate data record?
• Current (meta)data (realtime)
• GTS -- primary source
• Historical (meta)data
• poorly integrated
• need DMAC integration
• for now use a GTS archive(misses e.g. NOAA
  research cruises)

5
OSMC (meta)database at NDBC

• Met and Ocean surface data are updated daily with
  GODAE T-files (06, 12, 18, 24) from the
  previous day350 MB of data per day
• URLhttp//usgodae2.fnmoc.navy.mil/ftp/outgoing/fn
  moc/data/met/2005031706.tar.Z
• 1x1 degree gridded metadata netCDF summary files
  are updated daily
• The database repository begins 1 June 2004

6
OSMC (meta)database at NDBC

• Drifter updates from JCOMMOPS
• URL ftp//ftp.jcommops.org/Argo/Status/status.t
  xt
• Profiling float data from US GODAE Server
• Profile repository starts 1 January 2004
• Country information is assigned based on WMO
  allocation table
• URL http//www.wmo.ch/web/aom/marprog/Operation
  al-Information/buoy-ids.htm

7

Country - is based on ISO 3166, which defines
unique 2-character identifiers for each country.
OSMC RDBMS Entity Diagram





Organization - identifies an agency, institute,
university, or private company that owns or
operates a reporting platform
Datasource - identifies the source of the data.


Platform - identifies a ship, drifting buoy,
moored buoy station, or other platform that
reports marine data.
Observation - records the instance of a marine
observation for a reporting date and time.
Obs_Delay - used to retain ship observation to
enforce the 48 hour delay.
8
OSMC Observations Summary
Platform Type Count Observations
Drifting Buoy 2,328 15,148,559
Moored Buoy 738 4,769,004
C-MAN 252 2,456,953
Ship 2,514 1,734,996
Unidentified 14,013 1,287,329
Unknown 110 687,911
ARGO Float 1,715 109,323
Total 21,670 26,194,075
9
OSMC IT Environment

• Hosted at NDBC
• Dell PowerEdge 2650
• Dual Processor 3.06 GHz/1MB Cache
• Five 146 GB Harddrive
• Red Hat Enterprise Linux AS 4.0
• Oracle Database

10
Who are the users?

• Office of Climate Observation
• NOAA Observing system managers
• Scientific Community

11
Tools OSMC should provide

• Overview (where are the obs?)
• Drill-down (what are the obs?)
• Evaluation (are the obs adequate?)

12
Visualization evaluationOverview
all platforms reporting today
13
Visualization evaluationOverview
all platforms reporting air temp. today
14
Visualization evaluationOverview
all platforms reporting SST today
15
Visualization evaluationOverview
all platforms reporting SST today colored by
country
16
Visualization evaluationOverview
Drifters reporting SST today
17
Visualization evaluationOverview
U.S. drifters reporting SST today
18
Visualization evaluationOverview
U.S. drifters reporting SST this week
19
Visualization evaluationOverview
U.S. Pacific drifters reporting SST this month
20
Visualization evaluationOverview
U.S. Pacific drifters reporting SST this month,
colored by tail
21
Visualization evaluationOverview
22
User interface tools for evaluation

• Overview (where are the obs?)
• ? Drill-down (what are the obs?)
• Evaluation(adequacy of the observations)

23
Visualization evaluationDrill Down
mouse click for metadata summary
24
Visualization evaluationDrill Down
mouse click to view data
25
User interface tools for evaluation

• Overview (where are the obs?)
• Drill-down (what are the obs?)
• ?Evaluation(adequacy of the observations)

26
Visualization evaluation
Number of platforms per 1x1 degree box reporting
SST today
27
Visualization evaluation
Number of platforms per 5x5 degree box reporting
SST this month
28
Visualization evaluation
5x5 degree boxes this month that had one or more
SST obs every day
29
The OSMC doesnt look like a Live Access Server
but it is (Shown is the more traditional LAS
user interface)
30
Adopt-a-Drifter
is another specialized user interface to the same
OSMC server
31
Can the database keep up?

• Database performance evaluation
• Performance has increased by orders of magnitude
• Ever-increasing complexity of useful queries
• Need for spatially-based queries
• Can metrics be efficiently calculated directly
  from database?

32
A new view of the OSMC database
PV_PLATFORM PV_PLATFORM
ID VARCHAR2(9)
LAST_REPORT DATE
COUNTRY_ID VARCHAR2(2)
PLATFORM_TYPE_ID NUMBER(3)
DESCRIPTION VARCHAR2(80)
ORGANIZATION_ID VARCHAR2(20)
URL VARCHAR2(200)
PV_OBSERVATION_TSQP PV_OBSERVATION_TSQP
PLATFORM_ID VARCHAR2(9)
OB_DATE DATE
OBJECTID NUMBER(38)
SHAPE SDO_GEOM
PLATFORM_TYPE PLATFORM_TYPE
ID NUMBER(3)
NAME VARCHAR2(20)
DESCRIPTION VARCHAR2(40)
PLATFORM_SUBTYPE PLATFORM_SUBTYPE
PLATFORM_TYPE_ID NUMBER(3)
ID NUMBER(3)
NAME VARCHAR2(20)
DESCRIPTION VARCHAR2(40)
OBSERVATION_PARAMETER OBSERVATION_PARAMETER
OBJECTID NUMBER(38)
PARAMETER_ID NUMBER
VALUE NUMBER
DEPTH NUMBER
COUNTRY_MV COUNTRY_MV
ID VARCHAR2(2)
NAME VARCHAR2(50)
ISO_CODE3 VARCHAR2(3)
PLATFORM_SUBTYPE_TYPE PLATFORM_SUBTYPE_TYPE
PLATFORM_SUBTYPE_ID NUMBER(3)
ID NUMBER(3)
NAME VARCHAR2(20)
DESCRIPTION VARCHAR2(40)
PARAMETER PARAMETER
ID NUMBER(3)
NAME VARCHAR2(10)
DESCRIPTION VARCHAR2(40)
UDUNITS VARCHAR2(30)
ORGANIZATION_MV ORGANIZATION_MV
ID VARCHAR2(20)
NAME VARCHAR2(80)
COUNTRY_ID VARCHAR2(2)
URL VARCHAR2(200)
CONTACT_NAME VARCHAR2(40)
CONTACT_EMAIL VARCHAR2(60)
33
Providing an overview of OSMC

• Developing summary OSMC data table views
• Number of daily observations
• by platform
• by country, platform, and date, with drop-down
  country select
• As a demonstration of spatial query capabilities
• of platforms in Exclusive Economic Zones or
  ocean and sea polygons
• Including drill down to observations

34
(No Transcript)
35
(No Transcript)
36
(No Transcript)
37
(No Transcript)
38
OSMC and Google Earth
39
Whats ahead

• Security
• Delay ship observations by 48 hours
• Performance
• Support time-partitioning of database
• Create daily summary tables
• Metrics
• User feedback
• Continue work with OCO on UI tools

40
Whats ahead

• Accountability
• Continue adding variables
• Tease apart platforms better
• Reduce unidentified/unknown platforms
• Integration
• With climate products
• With ocean/climate modeling efforts
• Into IOOS GEOSS framework

41
How Can You Help?

• Types of metrics needed
• Useful tools
• Other platforms/datasets/variables, etc
• OSMC will be available through
• http//www.oco.noaa.gov

Thank You!