Rede IDDBrasil e softwares da Unidata

1
The Internet Data Distribution System
The Internet Data Distribution System
Group 17presenter Guilherme O. Chagas
(goc_at_ufrj.br)
4ª Reunión Red Ibérica MM5
2
IDD Network

• IDD Unidata Internet Data Distribution System
• Disseminating near real-time earth observations
  via the Internet
• Open to participation by universities and
  degree-granting institutions for purpouses of
  education and research
• Real-time data delivery system data sent as soon
  as available from the observing system
• Subscription based data delivery users specify
  in advance which data should be delivered to
  their system
• Community based architecture hierarchical data
  distribution scheme

3
IDD Network

• Organized and guided by the Unidata Program
  Center (UPC).
• Community of over 160 institutions vested in the
  common goal of sharing data, and tools to access
  and visualize that data
• A program of UCAR/UOP, sponsored by NSF
• Acts as the leader of a community with over 160
  institutions
• Vested in the commom goal of sharing data and
  tools to access and visualize earth-related data
• www.unidata.ucar.edu

4
IDD Network

• Community driven
• UPC
• develops, maintains and supports many tools at no
  charge
• coordinates the usage of high-interest data
• acts as a data facilitator
• Universities
• maintain computers and infrastructure to serve
  the community as defined by UPC
• Inject data of less interest in IDD without UPC
  involvement

5
IDD Network
(Unidata, www.unidata.ucar.edu)
IDD data relay scheme
6
IDD Network

• Members in the US include
• National Center for Environmental Prediction
  (NCEP)
• National Weather Service (NWS)
• Storm Prediction Center (SPC)
• Tropical Prediction Center (TPC)
• Aviation Weather Center (AWC)
• Hydrologic Prediction Center (HPC)
• Marine Prediction Center (MPC), etc...

7
IDD-Brazil effort

• IDD-Brazil extension of IDD network through
  South America
• Started at LPM/UFRJ in 2001
• Officially created in 2003 Meteoforum
• Joint effort involving
• UFRJ
• CPTEC
• USP
• UFPA
• Unidata
• Constant interaction with Universities in Portugal

8
IDD-Brazil effort

• Members in South America
• Universidade Federal do Rio de Janeiro
• Centro de Previsão de Tempo e Estudos Climáticos
• Universidade de São Paulo
• Universidade Federal do Pará
• Laboratório Nacional de Computação Científica
• Marinha do Brasil
• CEFET-RJ
• PUC Minas Gerais
• Instituto Nacional de Meteorologia
• Universidad de Buenos Aires
• Universidad de Chile

9
How the network operates

• LDM Local Data Manager the IDD building block
• Collection of programs that select, capture,
  manage and distribute arbitrary data
• Network client and server abilities, specific
  protocol
• Event-Driven data distribution allowing
  real-time distribution
• Extremely configurable and flexible

10
How the network operates

LDM communications scheme
11
How the network operates

• A worldwide community
• Multiple sources each LDM server can receive
  data from many sites and distribute it to many
  others
• Redundancy and reliability the IDD system is
  decentralized, has no datacenter
• Load distribution designed to avoid excessive
  traffic on any node or link
• Requires only an Internet connection worlwide
  reach

12
How the network operates
IDD topology
13
Available Data

• Types of data provided in Real-time
  (high-interest)
• Domestic Data Service (e.g., surface, upper air,
  buoy) (US only)
• Public Products Service (textual information
  e.g., watches, warnings, forecast discussions,
  etc.) (US only)
• International Data Service (worldwide
  observations)
• Operational forecast model output (e.g., GFS,
  NAM, UKMET, etc.)
• GOES Satellite imagery and derived products
• Aircraft Data (ACARS/AMDAR) Information
• NOAA Profiler Network data
• High-resolution model data from NCEP (e.g., GFS
  0.5 degree)
• WSR 88-D NIDS and Level II radar products (US
  only)
• Canadian Meteorological Center GEM model output
• NOGAPS and COAMP model data from FNMOC
• National Lightning network data
• GPS Precipitable water vapor observations

14
Available Data

• Experimental Data on IDD-Brazil
• INPE SCD (automated stations) network over 130
  meteorological stations
• DECEA (Departamento de Controle do Espaço Aéreo)
  a large number of airdrome stations currently
  unavailable on GTS
• CPTEC ETA regional model 00Z and 12Z runs.
• UFRJ WRF and MM5 model runs.

15
Available Data
Surface data available on Brazil
16
Available Data
CPTEC/ETA sample plots
17
Available Data

• Product visualization and generation using GEMPAK
• Collection of programs capable of decoding
  received data
• Generates graphics and analysis
• NMAP2 GUI that aggregates several programs in a
  unified interface
• Flexible based on tables (indexes) to configure
  its processes

18
Available Data
Satellite derived winds in NMAP2
19
IDD in Portugal

• Universidade de Aveiro using IDD since 2003
• Operational usage of NCEPs GFS (including 0.5
  degree) to run WRF and MM5.
• Project submitted to FCT, planned to provide
  training workshops to scientific community.
• Universidade de Évora distributing data to
  Africa
• SICLIMAD providing training to Portuguese
  speaking countries.
• Cooperation with CPTEC/INPE.

20
Summary

• IDD a community-driven network
• Freely available for Universities and
  Degree-granting institutions
• Delivers reliable, real-time data
• Expansible users can add data with virtually no
  costs
• Provides excellent tools to visualize and
  generate products
• Enhancing cooperation between different countries

21
Summary

• More information about IDD-Brazil
• - www.ufpel.tche.br/
• - www.lpm.meteoro.ufrj.br/idd-brasil
• www.cptec.inpe.br link to IDD-Brasil
• www.unidata.ucar.edu
• Yoshohiro Yamasaki - yamasaki_at_fis.ua.pt
• Guilherme O. Chagas (LPM/UFRJ) goc_at_ufrj.br
• David Garrana (LPM/UFRJ) garrana_at_acd.ufrj.br
• Waldenio Almeida (CPTEC/INPE)
  gambi_at_cptec.inpe.br