Overview and Status Updates of ApGrid

1
Overview and Status Updates of ApGrid

• Yoshio Tanaka
• National Inst. of AIST
• Grid Tech. Research Center

2
What is ApGrid?

• Asia-Pacific Partnership for Grid Computing.
• ApGrid focuses on
• Sharing resources, knowledge, technologies
• Developing Grid technologies
• Helping the use of our technologies in create new
  applications
• Collaboration on each others work
• Not only a Testbed
• Not restricted to just a few developed countries,
  neither to a specific network nor its related
  group of researchers
• Not a single source funded project

3
ApGrid History

• Asia-Pacific GF meeting in Yokohama, Japan with
  Charlie, Ben Siegel, Youichi, Satoshi2, etc.
  (July 2000)
• Presentation at GF5 in Boston by Satoshi
  Sekiguchi (Oct. 2000)
• Exhibits at HPC Asia (Sep. 2001)
• 1st ApGrid Workshop in Tokyo (Oct. 2001)
• Exhibits at SC2001
• Research Exhibition Asia-Pacific Grid
• ApGrid Panel in SC Global, SC2001
• 1st ApGrid Core Meeting in Phuket (Jan. 2002)

4
ApGrid Locations,Potential Partners

• Japan
• Laboratories
• AIST, RIKEN, KEK
• Universities
• Titech, Tsukuba, Osaka
• Korea
• KISTI
• Grid Forum Korea
• TEIN a link to Europe and Japan
• Australia
• ANU/APAC, Monash U, Adelaide
• Malaysia
• USM

• Thailand
• NECTEC
• Kasetsart University
• KMIT
• Taiwan
• NCHC
• Academia Sinica
• Singapore
• NUS, NTU, iHPC,
• United States
• SDSC, Indiana U.
• Potential Asian Partners
• Canada
• China
• Hong Kong
• Other A-P countries
• Vietnam, India,etc ..

5
1st Asia Pacific Grid Workshop in Tokyo (22-24,
Oct. 2001)

• 3 Tutorials
• Globus, Condor, Ninf
• 3 Keynotes
• Chip Cox (NSF)
• William Johnston (NASA)
• Ed Seidel (Max-Planck-Inc/NCSA)
• GGF updates
• Charlie Catlett, William Johnston, Steve Tuecke,
  Jennifer Schopf, Mary Thomas, Satoshi Matsuoka
• Vendor Session
• Fujitsu, NEC, Sun,
• Technical Session

6
SC 2001 Exhibition

• AIST, Japan
• Ninf-G GridRPC system
• TIECH, Japan
• Cluster and Grid Research in TITECH, GSIC
• Kyoto University, Japan
• High Performance Application on the Grid
• Monash University, Australia
• Queensland University of Technology, Australia
• Active Sheets and Gardens 2
• KISTI, Korea
• Supercomputing and Grid activities in KISTI
• Kasetsart University, Thailand
• Thai Grid
• NCHC, Taiwan had their own booth.

7
SC Global Panel

• Title Can the Asia Pacific Grid contribute to
  Sci. Tech. in Asia Pacific Region?
• 6 panelists from AU, JP, KR, TH, TW, US
• Connected Denver, AIST/Japan, Sydney
  VisLab/Australia via the Access Grid

8
ApGrid core meeting 2002
WELCOME to Phuket

• Laguna Beach Resort Hotel
• Laguna, PhuketJan 25-26, 2002

Special Thanks to Dr. Sissades Tongsima Dr.
Piyawut Srichaikul
9
Agenda of this meeting

• Discussion on drafting the structure of this
  community and membership
• Discussion on how to build the testbed
• Discussion on guide lines how to donate computing
  resources and how to configure them for
  interoperability awareness
• Report the status of current ApGrid nodes.
• Selection for the next ApGrid Workshop in 2002
• CALL other issues

10
ApGrid Testbed

• Experimental Testbed
• Have experience and knowledge on running VO
• Evaluation of Grid systems
• Running Applications
• Donation (Contribution) based

11
Possible ApGrid Nodes

• PC Clusters
• 64cpu Linux cluster (AIST, Japan)
• 64cpu Linux cluster (TITECH, Japan)
• 216cpu Linux cluster (Osaka U., Japan)
• 8cpu Linux cluster (Tsukuba U., Japan)
• 8cpu Linux cluster (Doshisha U., Japan)
• 8cpu Linux cluster (RIKEN, Japan)
• 32cpu Linux cluster (NCHC, Taiwan)
• 20cpu Linux cluster (NTU, Singapore)
• 14cpu Linux cluster (NUS, Singapore)
• 16cpu Linux cluster (KU, Thailand)
• 10cpu Linux cluster (KMIT, Thailand)
• 16cpu Sun UE Cluster (AIST, Japan)
• And more

• Supercomputers
• NEC SX-6i (RIKEN, Japan)
• Cray SV1 (AIST, Japan)
• SGI Origin 3200 (NUS, Singapore)
• Cray SV1 (NUS, Singapore)

12
Testbed Developments

• Security Infrastructure
• Based on GSI
• The ApGrid Testbed runs CAs and issues
  certificates for users and resources.
• The ApGrid Testbed allows multiple root CAs.
• Each country/organization/project could run its
  own CA and these could be root CAs on the ApGrid
  Testbed.
• The ApGrid Testbed is also planning to run an
  ApGrid root CA which is signed by a commercial CA
  such as Verisign.

13
Testbed Developments (contd)

• Information Services
• Based on GRIS/GIIS
• GrADS could be a good example

14
Testbed Developments Summary

• Globus Toolkit is used as a common software
  infrastructure on the ApGrid Testbed
• Globus Toolkit provides GSI, GRIS and GIIS
• Defacto standard of the low-level Grid middleware
• Provides better interoperability with other Grid
  testbeds

15
Resource Donation Guideline

• Required Software
• Globus Toolkit should be installed on every
  donated resource.
• Following information should be provided via
  GRIS/GIIS
• Host specific information (hostname, hardware
  architecture, etc.)
• Installed software (name, version, install
  directory, etc.)
• Detailed information could be better support for
  users.
• Announcements
• When the resource becomes ready, send an email to
  the appropriate MLs.
• Create login accounts
• Every user should be appropriately authenticated.
• Every user should provide his/her user
  certificate signed by a trusted CA.
• Maintenance
• Donated resources should be monitored
  appropriately.

16
Other issues

• Administrative work
• DNS domain (apgrid.org)
• Mailing list (core_at_apgrid.org,info_at_apgrid.org)
• Home Page (www.apgrid.org)
• Technical issues
• Cluster utilization on the Grid
• Most contributed resources are cluster systems.
• Supposed problems
• private IP address handling, MPICH-G2, etc.
• Standardization required? -gt Cluster BOF,
  Yesterday

17
Collaboration on the ApGrid
18
GrangeNet Rolein Advanced Networks
Global GRID Forum
Canarie
China
APGrid
StarTap
Korea
Japan
Internet2
Europe
APAN
Dante
South America
Singapore
Connection to other National Advanced Networks
and Testbeds Cooperation with other national and
major organisations in advanced communications
and grid services
GrangeNet
South Asia Middle East Europe
AARNet
This slide by courtesy of John OCallaghan_at_APAC
19
Nimrod/G and Grid EconomyA Market Paradigm for
Distributed Resource Management and Scheduling

• Rajkumar Buyya, David Abramson, Jon Giddy

Monash University, Melbourne, Australia www.buyya
.com/ecogrid
www.gridcomputing.com
20
Nimrod/G A Grid Resource Broker

• A resource broker for managing and steering task
  farming (parametric sweep) applications on
  computational Grids based on deadline and
  computational economy.
• Key Features
• A single window to manage control experiment
• Resource Discovery
• Trade for Resources
• Resource Composition Scheduling
• Steering data management
• It allows to study the behaviour of some of the
  output variables against a range of different
  input scenarios.

21
BioMed Grid Task Force

• Task Force set up for forward planning and
  coordinating implementation of IT infrastructure
  for the Biopolis and beyond,
• Technical Committees include
• HPC Storage
• Communications
• Security
• Software
• User needs and training

This slide by courtesy of Lawrence WC Wong_at_NUS
22
NUS BioGRID Architecture http//www.bic.nus.edu.sg
/biogrid
CRAY SV1 8 x CPUs GRID Host
SGI 3200 Irix GRID Host
Linux P-III 800MHz GRID Host/GIIS/MDS
Sun UltraSPARC Solaris GRID Host
Linux cluster 14xP-III 800MHz GRID Host
(Sun GridEngine)
This slide by courtesy of Tan Tin Wee Ong Guan
Sin_at_NUS
23
Grid Forum Korea(GFK) History
2002
2001. 3
5
6
10
8
7
9
GGF1(KISTI)
Start NGrid
Euro-Globus Workshop(MIC, KISTI)
GGF2(KISTI, NGrid, GFK)
GFK Committee
Asia-Pacific Grid Implementation Project(APEC TEL)
GGF3(KISTI, TEIN)
ApGrid(KISTI, NGrid, APEC TEL)
GFK1 (2001. 10)
Second GFK Second PRAGMA meeting (2002. 7)
This slide by courtesy of Jysoo Lee _at_ KISTI
24
On Going Projects in Thailand

• Developing application middleware for data
  intensive applications e.g.,
• bioinformatics,
• geoinformatics.
• Sponsoring Grid activities in Thailand
• High speed connection for ThaiGrid activities

This slide by courtesy of Sissades
Tongshima_at_NECTEC
25
Planned Grid Activities in Taiwan

• GeoGrid NCHC
• Support Hazard mitigation and governmental
  decision making Integrate Digitized GIS data,
  satellite image, city planning, earth quake data,
  flooding data etc.
• Metacomputing NCHC
• Work with HLRS, SCAI, PTS, U. Kentucky, iHPC.
• NDAP-Grid ASCC DataGrid for National Digital
  Archives Project
• BioGrid, Taiwan ASCC
• Focus Bio-informatic computing and databases
• Participation in Eu DataGrid ASCC
• Focus Country Member of Eu DataGrid for High
  Energy Physics

This slide by courtesy of Fang Pang Lin _at_ NCHC
26
Summary of Grid Projects in Malaysia
Project 1 Project 2
Title Compute Power Market P2P/Grid Computing (http//compute-power-market.jxta.org) The e-Science Grid The Development of Back-end Grid Engine and Grid Infrastructure
Objective Transforms the grid computing environment into a computational market in peer-to-peer computing style, which introduces resource trading on idle computational power across the Internet. To develop a grid infrastructure, resource allocator monitoring and secure grid-based transaction for the scientists. Application parallel molecular modeling iterative solver.
Hardware/ Software 5 PCs, Jxta Library, Java Platform Two 8-nodes short-area-network cluster, Globus
Collaborator Universiti Sains Malaysia (lead) Universiti Malaya Monash University Universiti Sains Malaysia (lead) Universiti Teknologi Malaysia University of Malaya Kolej Universiti Trengganu Monash University
Duration 1st Oct 2000 30th Sept 2002 1st Apr 2002 30th Sept 2003
Source of fund Ministry of Science, Technology and Environment of Malaysia Ministry of Science, Technology and Environment of Malaysia
This slide by courtesy of Fazilah Haron _at_ USM
27
PRAGMA Focus on Applications

• PRAGMA Application consortium
• What are the applications?
• What do the applications need?
• How do we make it happen?
• Advisory for resource centers and testbeds
• Provide structure for discussion (not just
  PI-to-PI)
• Formalize an exchange program of scientists and
  scholars
• Collaborate with and support existing Grid
  technology activities, such as
• Global Grid Forum (GGF), Asia Pacific Grid
  (APGrid), Asia Pacific Advanced Network (APAN)

This slide by courtesy of Henri Casanova _at_ SDSC
28
Grid Computing using Ninf-G

• Ninf-G is a Grid RPC system on the Globus
  Toolkit.
• A simple RPC-based programming model for the Grid
• Key property EASE OF USE, Easy going
• Grid-RPC is under standardization process in GGF
• Deploy Ninf-G on the ApGrid Testbed and have
  knowledge, experience, and feedback
• Develop real application programs using Ninf-G
• ApGrid (and other) Portals using Ninf-G

29
High Performance Grid Computing for optimization
problems using Ninf-G

• Prof. Fujisawa _at_ Kyoto Univ. (SC2001)
• Combinatorial Optimization Problems
• Nonlinear Optimization Problems

Slide by courtesy of Prof. Fujisawa
30
Summary

• ApGrid focuses on
• Sharing resources, knowledge, technologies
• Developing Grid technologies
• Helping the use of our technologies in create new
  applications
• Collaboration on each others work
• We should accelerate the testbed developments.
• We could have good experience on running REAL
  international virtual organization.
• Technical Issue, Policy Issue, etc.

31
For more info
ApGrid Home Page www.apgrid.org ApGrid Core
ML core_at_apgrid.org