A Testbed and Middleware for China EScience Environment CROWN Project A Status Report

1
A Testbed and Middleware for China E-Science
Environment CROWN ProjectA Status Report

• HU, Chunming
• Institute of Advanced Computing Technology
• Beihang University
• hucm_at_act.buaa.edu.cn
• http// www.crown.org.cn

2
Agenda

• Program Background
• Motivation Objectives
• The Research Programs
• Basic Idea in CROWN Project
• CROWN Middleware Testbed
• Architecture Software Components
• Testbed
• Pilot Applications
• CROWN What to do next

3
Program Background
4
Grid Activities in China

• 3 Major Projects/Programs
• CNGrid
• Nation-wide Grid Infrastructure
• Middleware and Applications
• NSFCGrid
• Provide Environment and Demo Applications for
  E-Science Community
• Provide Testbed for Grid Researcher
• ChinaGrid
• CGSP as the middleware, connecting Universities
  in China
• Applications among these resources
• Lots of domain-specific Grid Projects
• SDG by CNIC, CAS
• Campus Grid Tsinghua U., HUST,

5
Motivation of CROWN

• With the development of Internet
• Resources all around
• PCs HPC 10TFlops Supercomputer
• Storages, Information Center
• Digital Libraries, Softwares,
• Many Instruments like telescope, X-rays
• But
• The real usage of the resources are limited
• All CPU usage is below 0.5 world around
• Hard to make use of the resources
• Distributed
• Belong to difference Administration domains
• Management policy Differs from each other

6
Motivation (2)

• Scale of the Application is expending fast
• CERN
• High Energy Physics Experiments
• Peta-Scale data processing
• Virtual Observatory
• Hard to process locally
• Heterogeneous
• Balance between security usability
• Lack of guaranteed QoS
• Lack of easy-to-use using scenario middleware

7
Motivation of CROWN

• So we need
• The Capability of Resource Sharing and
  Collaboration to solve LARGER scale problem
• A Easy-to-use infrastructure, Hide all the
  details, such as Resource management, Security,
  Scalability, QoS Management
• To support the China E-Science Community
• Build tools and environments for the end user

8
The Research Program

• NSFC_Grid (3yrs, 2004-2006)
• Network-based RD Environment (E-Science Project
  in China)
• Beihang U., ICT,CAS
• CROWN China Research and Development Environment
  Over Wide-area Network
• 2004 2006, National Science Foundation of China
  (NSFC)
• By top 5 universities and institutes in China
• Beihang U. is the team leader.
• Goal Providing Grid-enabled research environment
  for scientists
• Provide a middleware suit for Service-based Grid
  computing
• Build a testbed for Grid technologies and Grid
  researcher
• Provide an easy-to-use Service Repository for
  E-Science community in China

9
Basic Idea of CROWN
Quality of Service
Service Overlay Network
Service
CROWN Portal
Resource
Service
Applications
Service
Resource
Applications
Service
Service
Applications
Resource
Service
Service
Security Architecture
10
Basic Idea of CROWN
QoS-enabling technology (Reservation and
Agreement-based mngt)
Quality of Service
Service Overlay Network
Service Provision Resource Mngt.
Service
CROWN Portal
Resource
Service
Job Mngt, Matchmaking Scheduling
Applications
Service
Overlay-based Service Management
Resource
Applications
Programming modal application integration
Service
Service Composition Workflow
Service
Applications
Resource
Service
Service
Trustworthy computing For distributed env.
Security Architecture
11
CROWN Middleware Testbed
12
Rich Client Applications
Web Applications
Portals
Rich Client Framework
Scheduler
Scheduler
Find Services
CROWN Designer
JDT
PDE
RLDS
RLDS
RLDS
Topology Management
Eclipse
RLDS
RLDS
RLDS
Generate Services
Register to
Register to
WfS
S
S
S
S
Workflow Engine
Node Server
Node Server
Node Server
Install / Config
Install / Config
Install / Config
PC
Cluster Front End
Device Host
Cluster Nodes
Devices
Resources
13
CROWN Node Server

• Node Server A GT 3.9.5 Extension as Service
  Container
• GAR a File format for portable service
• Hot/Remote Deploy with Security Consideration
• Resource Dynamic Information Collecting
  Reporting

14
Service Remote Deployment

• User Scenario
• Remote Service management
• Quick deployment on a large testbed
• Load balance
• ROST Remote Hot Service Deployment with
  Trustworthiness in CROWN
• the remote hot deployment by dynamically
  updating the runtime environment configuration
  and therefore avoiding restarting the runtime
  system.
• Security Problem Trust problem.
• Existing Efforts Sandbox, Security Model
• New approach An ATN-based trust model is
  introduced
• Add Active Trust Negotiation (ATN) for remote
  service deployment, which greatly increases
  flexibility and security of CROWN.

15
CROWN RLDS

• RLDS Resource Locating Descripting Service
• A distributed Grid information Service
  Architecture
• Soft-state, topology management of RLDS
• Collecting of Information of Resources (Hosts)
  Web / Grid Services
• Advanced GIQL Query to find available services

16
S-Club An Overlay based RLDS management mechanism

• Problem
• How to organize all the RLDS services to get
  better query performance?
• Observation
• Interest-based group in service provision and
  service requesting.
• S-Club Using short cuts to link all the RLDS
  services into an Overlay network
• Each club serves for a certain type of service
  while each GIS may join one or more clubs.
• Simulation and implementation result show that
  the solution gives better performance.

17
CROWN Designer

• Designer an Eclipse Plug-in for Grid Service
  Development
• Support the WSRF/WS-I Service Development and
  Deployment
• Auto Generation of Code Skeleton for Java Web
  Services

18
CROWN Workflow

• A BPEL4WS-based modeling tool Engine
• Graphical Modeling tool
• Workflow Engine Process Monitoring/Control
• Transaction Support

19
CROWN Portal

• Portal A JSP-based Web Interface
• User Registration
• Application Integration User Job Submission

20
Security Architecture for CROWN
Region 1
Region 2
Region KDC
Region CA
Identity Mapping Credential Converting Service
Domain KDC
Node 1
Domain Authentication Service
Node 2
Domain Authorization Service

Node n
Domain 2.1
21
Testbed

• CROWN Testbed (2005)
• 8 Sites, 4 Cities are connected using existing
  network infrastructure

Beihang University CNIC, CAS Peking
University Tsinghua University LASG, CAS
Chongqing University
National University of Defense Technology
HKUST Hong Kong University of Science
Technology
22
Testbed

• CROWN Testbed (2006)
• Deploy CROWN onto CNGRID Nation wide Testbed

Beihang University CNIC, CAS Peking
University Tsinghua University LASG, CAS
Xian Jiaotong University
Chongqing University
China University of Science Technology
Shanghai Super Computing Centre Shanghai Jiaotong
University
Shanghai
Xian
Hefei
National University of Defense Technology
HKUST Hong Kong University of Science
Technology
23
Pilot Applications

• Bioinformatics blast, cap3, genscan
• Atmospheric applications
• Climate simulation for past 1000 years
• AREM
• Regional Eta-coordinate numerical prediction
  model
• Rain or storm predication

24
(No Transcript)
25
Pilot Applications

• SDG Scientific Data Grid
• Share scientific data from all institutes of CAS
  with China or even world scientists
• UDMGrid University Digital Museum Grid
• Provide an integrated UDM data sharing
  environment using grid technologies
• Currently 4 UDMs are integrated
• Beihang university
• Yunnan University
• Nanjing University
• Shandong University

26
International Collaborations

• UK e-Science, 4 Universities
• OMII
• Testing from ETF since May 23, 2005
• France ObjectWeb, INRIA
• Germany FhG, JSI (Sino-German Joint Software
  Institute)
• Hong Kong University of Science and Technology
• Others, such as GT

27
Our Next step

• CROWN 2.0 Testbed and applications
• Add more applications and more services
• gViz (Large scale visualization, with Leeds U.)
• Atmosphere simulation, Video pattern recognize
• Extensive RD Cooperation
• Enhance trust management
• Combine with Wireless/Sensor network to enhance
  the CROWN testbed
• Add QoS support for Grid Jobs
• Collaborations with other Grid research community
• Standardization, Middleware Interoperability,Testb
  ed coordination and Interoperability

28
Useful Links

• CROWN Project
• http//www.crown.org.cn (Chinese Version)
• http//www.crown.org.cn/en (English Version)
• Institute of Advanced Computing Tech.
• http//act.buaa.edu.cn
• Beihang University
• http//www.buaa.edu.cn

29
Summary

• CROWN is a 3-year project funded by NSFC of China
  on E-Science testbed and research issues.
• CROWN is a Service-oriented Grid middleware suit
  and a test bed for China e-Science users.

30

• Thank You!
• QA

hucm_at_act.buaa.edu.cn