PRAGMA 11 in Osaka October 16th, 2006

1
PRAGMA 11 in OsakaOctober 16th, 2006
For understanding the earth- Concept and System
to integrate Global Earth Observation data -
2
Understanding the Earth

• Understanding the Earth become to be more
  important.
• The 10-Year Implementation Plan for GEOSS (Global
  Earth Observation System of Systems) agreed upon
  at the Earth Observation Summit
• The Earth Observation Promotion Strategy of the
  Council for Technology and Science Policy in
  Japan.
• Necessary to integrate Global Earth Observation
  data for understanding the Earth.
• The GEO Grid is proposedfor understanding the
  Earth.

3
Objectives of the GEO Grid

• Help Geo- scientists to understand
• Global warming, inventory of carbon dioxide
• Kyoto protocol, environmental burden
• Alternate energy
• Biomass
• Wind-power generator network
• Harvest yield prediction/estimation
• Weather, Soil, temperature, humidity, sunshine,
  etc.
• Help decision makers to plan
• Hazard mitigation
• Earthquake, Landslide, Flood, Volcano eruption,
  Tsunami
• Exploration of natural resources
• Oil, natural gas, mineral
• Unbeknown applications
• Games, Amusements, Personal geo-record/history,
  etc.
• Social science apps

4
What is the GEO Grid ?

• The GEO (Global Earth Observation) Grid is an
  ambitious concept and/or system to integrate
  whole data related to the earth observation.

Satellite Data
Grid Technologies
Geology
Map
Geo Contents
Applications
Resources
GIS data
Environment
Field data
5
The marriage of grid to global earth observation

• The marriage of grid technology to the global
  earth observation (i.e., satellite data) allows
  us to provides securely and rapidly large
  archives of different attribute of earth
  observation satellite data and integrated service
  with various observation databases and GIS data.

Satellite Data
Geology
Grid Technologies
Map
Geo Contents
IT Infrastructure
Applications
GIS data
Resources
Environment
Field data
6
It is a little story of the GEO Grid
Geo meets the vehicle
Satellite Data
Geology
Grid Technologies

• Differences in data format and access method
• Geographical distribution and ownership issues
• Ensure the security of resources and data
• Over incoherent security policies
• Complex workflow and capacity of resources
• Computing heterogeneity and Networking
  unreliability
• Scalability for larger capacity
• etc.

Map
Geo Contents
IT Infrastructure
Applications
GIS data
Resources
Environment
Field data
Grid meets the needs
7
Growing volume of satellite data needs e-Science !

• High Speed Internet Price down of Hard Disk
  Drive allow to develop the disk-based system for
  satellite data
• On-demand processing of huge size of satellite
  data may lead to many useful service and new
  unbeknown business.

TB
Hard Disk Size / \100,000,000
892TB (112?/GB)
Terra
ALOS
JERS
ADEOS
?????????????????????
8
Satellite Data for Global Earth Observation
Image from GOES-9 satellite, Image MODIS and
ASTER images of TERRA satellite and Field Sensor
data Detailed information collected from various
sources of different scale is integrated in a
single image
9
The GEO Grid leads for understanding the Earth

• A set of Information and Communication
  Technologies that allow people to get services
  without knowing

Science Technology RD
Decision Maker
Business
Geo Contents
Applications
IT Infrastructure
Grid Technologies
Satellite Data
Geology
Map
GIS data
Resources
Environment
Field data
10
AIST activities for the GEO Grid concept

• Develop the prototype (initial) GEO Grid system
• IT Infrastructure
• Adopt grid technology to accommodate applications
  with workflow hosted by Data Grids for the base
  map and Computing Grids for applications, map
  on-demand
• Provide standard web service interface to compose
  applications including OGC service and working
  well with any OGC compliant browser
• Maintain GEON interoperability
• GEO contents
• Provide remote sensing data on-demand as the base
  map generated from primary ASTER, MODIS, PALSAR,
  and etc.
• Provide Earth scientific information, such as
  geological and environment data, accumulated for
  a long period of time at AIST
• Applications
• Geological and environmental studies

11
AIST activities for the GEO Grid concept

• Develop the prototype (initial) GEO Grid system
• IT Infrastructure
• Adopt grid technology to accommodate applications
  with workflow hosted by Data Grids for the base
  map and Computing Grids for applications, map
  on-demand
• Provide standard web service interface to compose
  applications including OGC service and working
  well with any OGC compliant browser
• Maintain GEON interoperability
• GEO contents
• Provide remote sensing data on-demand as the base
  map generated from primary ASTER, MODIS, PALSAR,
  and etc.
• Provide Earth scientific information, such as
  geological and environment data, accumulated for
  a long period of time at AIST
• Applications
• Geological and environmental studies

12
AIST GEO Grid Architecture (IT Infrastructure)
Applications
Overlayable GIS data
Disaster prevention
Ecology
Agriculture
Geology
Field Sensors
GSJ data
GIS data
USGS data
Visualization service
GML/G-XML
Application Middleware
Std Web Service I/F
i GEON
Interoperable
Tiled Wall Display
OGSA basic services
AIST CA
GEON CA
Follow and lead global standards
WSRF/WSN Grid AAA SAML
Data Grid
Computing Grid
gfarm
Application hosting engine
Base Map
PALSAR
ASTER
MODIS
Tsukuba (Japan)
ASTER MODIS
Geometric, Radiometric Atmospheric
Correction Mosaic Composite, Image Processing
DSM/DEM
PALSAR
AIT(Thailand)
No longer Tape Archives, All scenes on-demand
MAP on Demand
AIST Supercluster (11TFlops)
210TB /P4 3.5TB(raid5)/node x 60C
AIST
MODIS
L0 or L1
NASA(USA)
PALSAR
L1A data will not be in public
ASTER
HATOYAMA (Japan)
13
GEO Grid in future (IT Infrastructure)
Expand to the otherorganizations
Visualization service
Visualization service
Application
OGC
OGSA
Appli. Middleware
Std Web Service I/F
Interoperable
OGSA basic services
Same Grid File System
AIST
Computing Grid
Data Grid
Prototype system in AIST
Expand to world
14
GEO Grid in future (IT Infrastructure
Disk-based system)
Magnetic Tape-based system on EOS Data Gateway
NOAA
Magnetic Tape-based system on EOS Data Gateway
Australia
Singapore
China
NOAA
APAN
Bangladesh
Thailand
NIES
Malaysia
AIST
Disk-based system using grid file system on
Tsukuba-WAN
AIST
JAXA
China
ftp get
India
Disk-based system using grid file system on
Tsukuba-WAN
Japan
-----
Univ. of Tsukuba
NIES
Sri Lanka
Univ. of Tsukuba
Korea
AFFRC
Philippines
Hong Kong
APAN
AFFRC
JAXA
Taiwan
Thailand
NewZealand
Pakistan
Tsukuba
SIDaB-AIST DB on gfarm
MODIS DB using grid file system on Tsukuba-WAB
MODIS DB using gfarm on APAN
UoT-NIES-AFFRC-JAXA-AIST appli. on Tsukuba WAN
Appli. on APAN
15
AIST activities for the GEO Grid concept

• Develop the prototype (initial) GEO Grid system
• IT Infrastructure
• Adopt grid technology to accommodate applications
  with workflow hosted by Data Grids for the base
  map and Computing Grids for applications, map
  on-demand
• Provide standard web service interface to compose
  applications including OGC service and working
  well with any OGC compliant browser
• Maintain GEON interoperability
• GEO contents
• Provide remote sensing data on-demand as the base
  map generated from primary ASTER, MODIS, PALSAR,
  and etc.
• Provide Earth scientific information, such as
  geological and environment data, accumulated for
  a long period of time at AIST
• Applications
• Geological and environmental studies

16
AIST GEO study background (GEO contents)

• Remote Sensing (Satellite) Data
• Sensor development and calibration
• Energy Technology Research Institute
• National Metrology Institute of Japan
• Image processing correction (Remote Sensing)
• Energy Technology Research Institute, Information
  Technology Research Institute, and etc.
• Geological Survey of Japan
• Geological and Environment data
• Geological Map, GIS data, land-based (in-situ)
  data
• Geological Survey of Japan
• Research Institute for Environmental Management
  Technology

17
AIST related to the satellite sensors (GEO
contents)

• JERS-1 Japanese Earth Resource Satellite-1
  (1992.2)
• OPS Optical Sensor
• SAR Synthetic Aperture Radar
• IMG Interferometric Monitor for Greenhouse Gases
  (1996.8)
• Flying on JAXAs ADEOS
• ASTER Advanced Spaceborne Thermal Emission and
  Reflection radiometer (1999.12)
• Flying on NASAs TERRA
• PALSAR Phased Array type L-band Synthetic
  Aperture Radar (2006.1)
• Flying on JAXAs ALOS
• Next generation

18
Available Satellite Data
Sensor Characteristic Higher Level data Original Data
ASTER Global DEM generation (stereo pair), Excellent geo-location accuracy, Powerful spectral analysis. ? JPEG images (Full resolution)?Land-cover/Land-use map, Many kinds of Land Surface Map (Seamless DEM ?) ? Only for Research Collaboration
MODIS Daily Global observation. VIS-TIR 32bands for ocean, atmosphere and land ? ?
PALSAR JERS/SAR Synthetic Aperture Radar ?? ??
JERS/OPS DEM generation, VIS-SWIR spectral bands ?? ??
19
Available Geological Data (GIS data)
Characteristic Web browse WebGIS WMS WFS
Geological Database on RIO-DB Active fault map, Geochemical Map, and etc. ?
G-INDEX Total index web site for all Geological Data Base in AIST ? ? ? ?
GeoMapDB Seamless Geological Map, many kinds of integrated map ? ? ? ?
20
Available Environmental in-situ Data
Characteristic Web browse WebGIS WMS WFS
AsiaFlux (AIST operated sites) CO2, H2O, Heat Flux ? now planning - - ??(Text) now planning
PEN(Phenological Eyes Network for the validation of Remote Sensing data) Phenology, Atmospheric and Vegetation Parameter, Spectral Information ?now developing - ? now planning ? (Images and Text) now planning
21
ASTER Main content of AIST GEO Grid system

• ASTER was developed by METI with AIST scientific
  engineering supports
• Global land coverage of Digital Elevation Model
  of 15m spatial resolution
• Excellent geo-location accuracy
• Easy to mosaic (or make a seamless image/DEM)
• Easy to overlay to GIS data
• Powerful spectral analysis
• VNIR 3 bands (backward 1band)/SWIR 6 bands/TIR 5
  bands
• 2000

22
ASTER/TERRA MODIS/TERRA image processing
geometric, radiometric/atmospheric corrections in
AIST GEO Grid System
MODIS
ASTER
MODIS 1deg Product (Precipitable Water Aerosol)
L1A, L1B
L0 ? L1A
MISR, MOD04, AeroNet, Skynet ?
Cloud Para.
Climate data (NCEP/NCAR, ECMWF, )
QA
L3A01
Advanced Radiometric Correction
DEM(ASTER with SRTM, GTOPO30 etc)
TOA Radiance
TOMS/EarthProbe OMI/AURA
DEM-based Applications(Global Mosaic)
Cloud info.
L3B
Vicarious Cal. Lunar Cal., ...
LandCover
LUTsbased on Modtran
Atmospheric Topographic correction (and BRDF
correction )
LUT
ASTER Surface Reflectance (VNIR,SWIR)
MODIS Surface Reflectance (VIS-SWIR)
Solar Models
LUTs
LUTsbased on 6S
Basic Parameter Processing for Applications
23
ASTER DEM (15m spatial resolution)
Shiretoko, Japan
SRTM 90m
ASTER 15m
24
ASTER excellent geo-location accuracy
GIS ??????????????????????
???????????????????(Boulder, CO)
?????????????????
25
Landslides volume estimation using ASTER DEM
Synthetic bird eyes view with ASTER image and DEM
Volume 0.06 km3, area 0.5 km2 at DEM
difference gt 50 m
14NOV2000
11OCT2005
26
ASTER DATA FLOW (JAPAN-US Relation)
TDRS (Tracking and Data Relay)
Control cmd
Terra/ASTER
600Scenes/day
Uplink Cmd
lt 60GB/day
70GB/day gt
AIST
ERSDAC
ERSDIS/ NASA
ASTER/GDS

• Any individual scene (DEM/ortho) available every
  6 hour
• Mosaic covering the whole east Asia will be
  constructed
• in this year
• 70GB/day x 5years 100TB, x8yr 150TB
• Higher level product on-demand

Global Lambda Integrated Facility Pacific Map
August 2005Predicted Bandwidth for Scheduled
Experiments
Visualization courtesy of Bob Patterson,
NCSA/University of Illinois at Urbana-Champaign. D
ata compilation by Maxine Brown, University of
Illinois at Chicago. Earth texture from NASA.
www.glif.is
27
AIST activities for the GEO Grid concept

• Develop the prototype (initial) GEO Grid system
• IT Infrastructure
• Adopt grid technology to accommodate applications
  with workflow hosted by Data Grids for the base
  map and Computing Grids for applications, map
  on-demand
• Provide standard web service interface to compose
  applications including OGC service and working
  well with any OGC compliant browser
• Maintain GEON interoperability
• GEO contents
• Provide remote sensing data on-demand as the base
  map generated from primary ASTER, MODIS, PALSAR,
  and etc.
• Provide Earth scientific information, such as
  geological and environment data, accumulated for
  a long period of time at AIST
• Applications
• Geological and environmental studies

28
GEO Grid use case scenarioVolcano monitoring
Energy Cone Simulation
?3DTemp
Melapi
AP photo
ASTER
29
????????????????????????
30
??? ??????? ???????
31
??? ??????? ????
32
GEO Grid use case scenario Environment monitoring
Satellite TERRA
ASTER
MODIS
by PEN
Link through ASTER high resolution images (Scale
up/down for land-cover, cloud contamination, and
etc.)
In-situ data for validation/assimilation
by BEAMS
Modeled Net Primary Production
Daily Global observation by MODIS
33

34
(No Transcript)
35

TWD ????????
?????????
36

37
--- Result of 2002 BEAMS ---
??
Spring early coming ? Anomaly part of NPP
days
??
?????
2001-2005??
?????
2001-2005??
???? -gt (??????) -gt ?????????????????? ???????????
???????????????????????
38
--- Result of 2003 BEAMS ---
Long Rainy Season ? Low PAR ? Low NPP
PAR
?????
2001-2005??
?????
2001-2005??
????????????????????????????????????? ????????????
????????????????
39

40
GEO Grid

• The GEO (Global Earth Observation) Grid is an
  ambitious system to integrate whole data related
  to the earth observation.
• The system aims at contributing to the solving of
  global social problems such as environment
  conservation, resource exploration, natural
  disaster prevention, and risk management. It also
  supports new business model services combined
  with urban information, geographical information,
  social news, etc.
• The marriage of grid technology to the global
  earth observation allows us to provides securely
  and rapidly large archives of different attribute
  of earth observation satellite data and
  integrated service with various observation
  databases and GIS data.
• In AIST, the core contents of the system are the
  observation data from the earth observation
  satellite sensors (ASTER, MODIS, PALSAR and etc.)
  and geo-scientific information, such as
  geological and environment technology data,
  accumulated for a long period of time at AIST. As
  a core technology, the GEO Grid provides
  international standard compliant grid technology
  and develops systems.
• In this PRAGMA, the new working group
  Geo-science Observing GEO is just started.
  Your participation are welcome !

41
Thank you very much for your attention !
Global Earth Observation Grid
http//www.geogrid.org/