Title: John.C.Cartwright,
1NOSA A Spatial Portal to NOAA's Observing
Systems
John.C.Cartwright, Kelly Stroker, David
Froehlich, Anna Milan CIRES, University of
Colorado Ted.Habermann_at_noaa.govNOAA, National
Geophysical Data Center
2NOAA Maps
Over 400 maps have been captured from NOAA Web
pages and described in the NOAA Maps Project.
3http//nosa.noaa.gov
The NOSA website provides information about the
program and its history as well as several access
paths to the NOSA database.
4NOSA Website Architecture _at_ NGDC
WIST
LAS
FYP
Stations, QA
Map
Spreadsheet, E-mail, txt, etc.
Geospatial Database
Metadata
Pipeline
5ArcIMS Map with Multiple Data Layers
6ArcIMS Site and Metadata Links
7ArcIMS Site and Data Links
8What just happened?
Geospatial Database
COTS IMS
Spatial Query
Scientists throughout NOAA contributed
Links back to existing WWW resources
9Integrated Satellite and In-Situ Data Access
10Observation Density
11Find Your Place-NOSA in Your Neighborhood
Geospatial database very general searches
12Results NWS-COOP in Idaho
13OGC Web Map Services
14Web Image Slide Trays (WIST)
The WIST provides simplified access to maps of
particular layers for pre-determined regions
using a Web Map Server (WMS) and a custom tag
library for Java Server Pages.
15OGC Web Feature Service
16NOSA and Google Earth
17Technology Cycle
Technological Disruption
Selection
Era of Ferment
Dominant Design
Disruption 2 (destroys existing competence)
TIME
18One Connection
LARC
Nexrad
CBOY
Http Request
Spatial Query
NOAA Observing System Database
CMAN
Not one for eachObserving System
KML Response
19NOSA Website Architecture _at_ NGDC
WIST
LAS
FYP
Stations, QA
Map
Spreadsheet, E-mail, txt, etc.
Geospatial Database
Metadata
Pipeline
20The Data Processing Pipeline
A pipeline executes a sequence of plug-able data
processing tasks. The NGDC data processing
pipeline provides a set of pipeline utilities
designed around work queues that run in parallel
to sequentially process data objects. The
pipeline is an open source project hosted in the
Jakarta Commons Sandbox (http//jakarta.apache.org
/commons/sandbox/index.html). Processing steps
are specified as a series of stages in an XML
configuration file.
21DMSP Orbit Processing
Stage 1. Find Matching Files Stage 2. Avoid
Duplicate Processing Stage 3. Read Data / Create
Spatial Objects Stage 4. Low-Res Thinning Stage
5. High-Res Thinning Stage 6. Write Spatial Data
to Database
22Find Matching Files
lt!-- Get names of files to process from the
ingest directory --gt ltstage className"org.apache.
commons.pipeline.impl.FileFinderStage
filePattern".\.OIS"gt ltstageDriver
className"org.apache.commons.pipeline.impl.Single
ThreadStageDriver"/gt ltenqueuegt
ltvaluegt/mnt/stout/raid/lv2/ois/incoming/lt/valuegt
lt/enqueuegt lt/stagegt
23Treasure??