Data Integration

1
Data Integration

• Chaitan Baru
• Ilya Zaslavsky
• Ashraf Memon
• Michalis Petropoulos
• Yannis Papakonstantinou
• Bertram Ludaescher
• San Diego Supercomputer Center

2
GEON IT Activities

• Two-tier approach to bringing IT to scientific
  applications
• Provide state of the art IT infrastructure
• Identify and address new IT research
• Short term targets (1 year) vs. long-term
  strategy (3year, 5year)
• IT Working Groups
• Concept Spaces and Semantic Mediation
• Tools and services
• Core Grid Services
• Shared cybertools
• OGSA stack, authentication, data discovery, data
  integration, data replication
• Application Services
• Geoscience domain cybertools
• Advanced Visualization

3
Data Integration

• Database integration
• Based on join operation in relational databases
  (e.g. SSN, city name, )
• Integrating layers in a single GIS (spatial
  joins)
• Semantic integration
• Linking data via concept spaces
• Domain Model-based integration
• Linking data via computational models
• E.g., respatialization

4
SDSC Grid-enabled Mediation Services(GeMS)

• Registration/Discovery
• Situate a data source in 4D, topic, and process
  space. Describe source capability.
• Federation/Access
• Provide standard interfaces to access data
• Define integrated views
• Publication
• Move data from private space to public space,
  or provide a public view of private data
• Replication / Caching
• Allow for replication/caching of data (at
  different granularities)

5
Leverage on-going efforts

• Open Grid Services Architecture (OGSA)
• Data Access and Integration Grid Database
  Service (GDS)
• IBM Grid Services
• E.g., Grid data Movement and Replication
• SDSC Storage Resource Broker (SRB)

6
GeMS Scenario
Client

• Query-based access
• 3rd-party transfer

Surf Query Planner
Mediator
Surf Plan
Surf Logical ? Physical Query Plan binding
Wrapper
Ontology Service(s)
7
GeMS Components

• Query Planner
• Logical Query Plan to Physical Query Plan
  Resolver
• Replica selection
• Dealing with failover
• QoS