AIST NRA-02 Presentation to SSO

1
Standard-compliant Grid Framework for Geoscience
Virtual Products Modeling
Aijun Chen, Yuqi Bai, Yaxing Wei, Liping Di, Yang
Liu
Dr. Aijun Chen
Center for Spatial Information Science and
Systems (CSISS) George Mason University (GMU)
2
Outline

• Introduction
• Open Geospatial Consortium (OGC) Web Services
• Geospatial Grid Services
• Abstract Model and Grid Services Workflow
• System Architecture of Geospatial Grid Framework
• Testbed and System Implementation
• Conclusion
• Future Vision

3
Introduction

• Grid computing has appeared as a new e-science
  information technology for addressing the
  formidable challenges of complete integration and
  utilization of heterogeneous computing systems
  and data resources.
• The Open Geospatial Consortium (OGC) has been
  devoting to the interoperability of geospatial
  resources. It has produced a set of web-based
  data interoperability specifications such as WCS,
  WMS, CS/W.
• CSISS at GMU has implemented several
  OGC-specification compliant Web Services, such as
  WMS, WCS and CS/W.
• Try to establish a Grid service-oriented
  geospatial standard-compliant Grid framework for
  users to build up their application abstract
  processing model, execute it and get back users
  desired geospatial products through utilizing the
  OGC standard services and data and computing
  resources provided by Grid technologies.

4
The OGC Web Services

• The Web Coverage Services (WCS) specification
  defines the standard interfaces between web-based
  clients and servers for accessing coverage data.
• -- All imagery type of remote sensing data is
  coverage data.
• The Web Feature Services (WFS) specification
  defines the standard interfaces between web-based
  clients and servers for accessing feature-based
  geospatial data.
• -- vector and point data are feature data.
• The Web Map Services (WMS) specification define
  the standard interfaces for accessing and
  assembling maps from multiple servers.
• -- visualization of geospatial data
• The Catalog Services for Web (CS/W)
  specification defines the interfaces between
  web-based clients and servers for finding the
  required data or services from registries. Its
  based on the ebRIM.
• WCS, WFS, CSW, and WMS form the foundation for
  the interoperable geospatial data access and
  service environment.
• The Grid-enabled standard Portals for the above
  OGC services.

5
Design of the Information Model (IM) of CS/W
Extension of OGC CSW for geospatial resources
RegistryObject
ClassificationSchema
Service
Service IM (ISO 19119)
Classification
ExtrinsicObject
Association
ServiceBindings
CSWExtrinsicObject
RepositoryItem

RegistryEntry
Dataset IM (ISO 19115)
NASA EOS Core System (ECS)
Slot
ebRIM OGC Catalogue Service for CS/W OGC
Catalogue Service for ISO 19115/19119
6
Geospatial Grid Services and other Grid services

• Grid-enabled Catalog Service for Web (GCS/W)
• Grid-enabled Web Coverage Service (GWCS)
• Grid-enabled Web Map Service (GWMS)
• Intelligent Grid Service Mediator (iGSM)
• Replica and Optimization Service (ROS)
• Data Transfer Service (DTS)
• Other Grid Services for application

7
Grid Enabled Catalogue Service for Web (GCS/W)
Client Requester Send Data requirement Obtain
An optimal data service among the VO.
Legend IM Information Model CS/W Catalogue
Service Web RLS Replica Location Service MDS
Monitoring Discovery Service VO Virtual
Organization
Integration of Information Model of CSW and Grid
RLS/MDS
8
Intelligent Grid Service Mediator (iGSM)

• (iGSM intelligent Grid Service Mediator)
• Support WCS portal and WMS portal to distribute
  their request to proper GWCS and GWMS.

9
Concept Models of Virtual Geospatial Products
modeling and virtual data services
no service
data service
User Requested
User Obtained
Archived geo-object
User geo-object
Geospatial web/Grid services
Intermediate geo-object
Automated data transformation service(WCS/WFS)
10
Abstract Model for Modeling Virtual Products

• Information Model of VDP
• DTC Data Type Catalogue. Data are classified
  into type based on their scientific meaning.
  e.g. DEM, Slope, SlopeAspect, Landslide etc.
• STC Service Type Catalogue. Services are
  classified into service types based on their
  scientific meanings. e.g. DEM2Slope,
  DEM2SlopeAspect, SlopeAspect2Landslide,
  DEM2Landslide etc.

ServiceInstance
DataType
ServiceType
associates to
process
uses
Real Data
input
decides
GVWCSInstance
ServiceType
Virtual Data
output
associates to
DataType
associates to
DataType
DataInstance
11
Design of Virtual Geospatial Products

• System Architecture

User
GWCS
Geospatial Data
Model Designer
Query
GVWCS
Register AM
GCS/W
GWCS
Grid Instantiation Service
GWICS
Grid Workflow Engine Service
GWCTS
GSI (gt4.0.1)
12
Building up Virtual Geospatial Products

• Abstract model based user interface for modeling
  virtual geospatial products

http//laits.gmu.edu/vdp
13
Registry of Abstract Model of Virtual Products

• Registration of Abstract Model to GridCS/W

14
Design and Implementation of Virtual Product

• Instantiation of the Abstract Model to
  BPEL-compliant Concrete Workflow

Abstract Model (AM)
AM Schema
ServiceType
STC
DataType
DTC
ServiceInstance
WSDL
DataInstance
Grid Instantiation Service
Physical Workflow
Grid BPEL Engine
15
Design of BPEL-compliant Workflow Engine for VDP

• BPEL engine architecture Execute Grid Services
  with Standard BPEL workflows.

16
Geospatial Grid Services for Materialization of
VDP

• Existed Grid services for modeling VDP
• GWCS
• GWMS
• GCS/W
• GCSF
• GWICS (Grid-enabled WICS)
• GWCTS (Grid-enabled WCTS)
• GRLS (Grid-enabled RLS)
• For the prototype demonstration of VDP,
  additional Grid service instances have been
  developed
• GridSlope
• GridAspect
• GridCalifornia_WHR3_Classification
• GridNDVI
• GridLandslide_Susceptibility_2i
• GridLandslide_Susceptibility_4i

17
System Architecture of Geospatial Grid Framework

• Diagram of user request and data workflow

Client
Other WCS
User Tier
V
V
default WCS/WMS portal IP
CSW Portal
OGC Tier
LAITS WCS Portal
ECHO Catalog
LAITS WMS Portal
V
GCSF
V
V
V
GVWCS
GESGCS
V
LAITS GridCSW
V
V
Grid Tier
NetCDF Data
Real data request
V
Real datarequest
V
GWES
iGSM
HDF-EOS Data
Other Data
V
ROS
11
GridWICS
V
GridWCTS
AmesGridWCS
LLNLGridWCS
LAITSGridWCS
Ames DTS
RLS
MDS
Globus Toolkit 4.0/4.0.1 with GSI
18
Implementation Testbed

• Grid Security (GSI) and VO Setup

GMU (Solaris) (laits.gmu.edu) Globus 4.0.1 with
GMU Certs.
NASA SGT (Linux) (arao2.sgt-inc.com) Globus 3.2
with CEOS Certs.
GMU CA center
GMU (Mac) (geobrain.laits.gmu.edu) Globus 4.0.1
with GMU Certs.
NASA (Linux) (former.intl-interfaces.net) Globus
3.0 with CEOS Certs.
CEOS VO
IPG CA center
GMU (Linux) (data.laits.gmu.edu) Globus 4.0.1
with GMU Certs.
ESG CA center
Ames ipg05 (Linux) (ipg05.ipg.nasa.gov) Globus
4.0.1 with IPG Certs.
LLNL esg2 (Linux) (esg2.llnl.gov) Globus 4.0.1
with ESG Certs.
GMU LAITS VO
NASA IPG VO
LLNL ESG VO
Authentication among different VO
19
Conclusion

• The Grid service-oriented approach to serving
  geospatial data is a promising strategy for
  establishing an open, wide and secure system that
  securely provides access to huge volumes of
  distributed geospatial data/information through
  querying geospatial catalogs.
• Devised a new geospatial abstract information
  model for building up geospatial application
  abstract model.
• Applied the abstract model to Grid environment
  and concrete it to Grid-service workflow and
  execute it with Grid Workflow Engine.
• Implements a prototype system that demos a
  landslide virtual data products.

20
Future Vision
GCSW and iGSM cooperate as Ganglia
GWCS, GWMS, GWICS, GWCTS as Nerve Cell
Grid and Web Services related technologies as
basic infrastructure

• Building up abstract model to produce virtual
  data products when user request it.
• Using ontology-based semantic solution to
  provide automatically users application modeling
• More Cell and more powerful Ganglia will be
  developed for more easily and completely Earth
  Science Data obtainments.
• More specific Ganglia and Cell will be provided
  for special domain user requirements.

21
Thank You !
Any Questions ?
achen6_at_gmu.edu