GRID COMPUTING INFRASTRUCTURE, PROBLEMS AND PERSPECTIVES IN LITHUANIA

1
GRID COMPUTING INFRASTRUCTURE, PROBLEMS AND
PERSPECTIVES IN LITHUANIA
Dalius Mažeika, Algimantas Juozapavicius Viln
ius Gediminas Technical University, Sauletekio
11, LT-10223 Vilnius Vilnius University
Naugarduko 24, LT-03225 Vilnius
Informacines technologijos 2006, Kaunas,
2006.01.25 - 26
2
Outline

• Grid infrastructure overview
• History and definitions
• GRID technologies, architecture, standards,
• Security Infrastructure
• Grid applications and projects
• LitGrid project
• Background
• Infrastructure
• Applications
• BalticGrid project background

3
Situation before GRID

• Present situation
• Parallel processing PVM/MPI, clusters
• Peer2Peer systems Seti_at_Home, Napster
• Separate access to each resource

4
Grid is future of IT infrastructure

• Future
• multinational projects
• resources location is irrelevant
• plug-n-play access to all the resources

5
The Grid Computing Metaphor
Mobile Access
Supercomputer, PC-Cluster
G R I D M I D D L E W A R E
Data-storage, Experiments
Desktop
Hoffmann, Reinefeld, Putzer
Internet, networks
6
What is Grid ?

• Grid is not
• The next generation Internet
• New Operating System
• Grid is
• way to exploit unused CPU
• new mode of paralell computing
• new mode of P2P networking
• Definitions
• A computational grid is a hardware and
  software infrastructure that provides dependable,
  consistent, pervasive, and inexpensive access to
  high-end computational capabilities (Ian Foster,
  1998)
• Grid is infrastructure that enables the
  sharing, selection, aggregation of geographically
  distributed resources (computers, software,
  databases, people) for solving large-scale
  problems/applications. (Vaidy Sunderam)

7
Grid checklist (by Ian Foster)

• coordinates resources that are not subject to
  centralized control (Otherwise, we are dealing
  with a local management system.)
• using standard, open, general-purpose protocols
  and interfaces (Otherwise, we are dealing with an
  application specific system.)
• to deliver nontrivial qualities of service. (So
  that the utility of the combined system is
  significantly greater than that of the sum of its
  parts.)

8
Layered Grid Architecture
(Globus Project)
9
Fabric Layer

• The diverse mix of resources that may be shared
• Individual computers,
• Condor pools,
• File systems,
• Archives,
• Metadata catalogs,
• Networks,
• Sensors, etc., etc.
• Defined by interfaces not physical characteristics

(Globus Project)
10
Connectivity Layer

• Communication
• Internet protocols TCP/IP, UDP, SNMP, routing,
  etc.
• Security Grid Security Infrastructure (GSI)
• Uniform authentication, authorization, and
  message protection mechanisms in
  multi-institutional setting
• Single sign-on, delegation, identity mapping
• Public key infrastructure, SSL, X.509 standard
• Supporting infrastructure
• Certificate Authorities,
• Certificate key management,

PROXY1
PROXYn
CA
USER
(Globus Project)
Signature
Signature
Signature
11
Resource Layer

• Grid Resource Allocation Management (GRAM)
• Remote allocation, reservation, monitoring,
  control of compute resources
• GridFTP protocol (FTP extensions)
• High-performance data access transport
• Grid Resource Information Service (GRIS)
• Access to structure state information
• Others emerging Catalog access, code repository
  access, accounting, etc.
• All built on connectivity layer GSI IP

(Globus Project)
12
Collective Layer

• Index services, metadirectory services
• Custom views on dynamic resource collections
  assembled by a community
• Resource brokers (e.g., Condor Matchmaker)
• Resource discovery and allocation
• Replica catalogs
• Replication services
• Co-reservation and co-allocation services
• Workflow management services

(Globus Project)
13
Globus Toolkit Layered Architecture
Applications
High-level Services and Tools
DRM
Grid Status
PUNCH
Cactus
Condor-G
MPI
Nimrod/G
globusrun
Core Services
GRAM
GASS
Metacomputing Directory Service
Globus Security Interface
Replica Catalog
GridFTP
I/O
Local Services
Condor
MPI
TCP
UDP
Solaris
LSF
NQE
PBS
AIX
Linux
(Globus Project)
14
Middleware components
Replica Catalogue
User interface
Information Service
Resource Broker
Author. Authen.
Input sandbox Broker Info
Output sandbox
Computing Element
Logging Book-keeping
Job Status
15
Globus, Web Services and OGSA

• Globus Tolkit
• Protocols and services GRAM, GridFTP, MDS
• Grid Security Infrastructure (GSI)
• Web Services
• System integration
• Service orientation
• XML based SOAP, WSDL
• OGSA/OGSI Open Grid Services Architecture/Infrastr
  ucture
• Basic infrastructure for distributed state
  management
• Can be used as a basis for building Globus
  Services
• Globus Toolkit 3.0

16
Open Grid Services Architecture

Users in Problem Domain X
Applications in Problem Domain X

Application Integration Technology for Problem
Domain X

Generic Virtual Service Access and Integration
Layer

OGSA










OGSI Interface to Grid Infrastructure

Compute, Data Storage Resources




-

Distributed

Virtual Integration Architecture
17
Some Grid projects
US projects
European projects
18
Some Grid projects timeline
2000 2001 2002 2003 2004 2004 2005 2006 2007 2007 2008 2008 2009 2010
LCG
EDG EDG EDG EGEE EGEE EGEE EGEE
GriPhyN, PPDG GriPhyN, PPDG VDT
CROSSGRID CROSSGRID CROSSGRID CROSSGRID CROSSGRID CROSSGRID
DataTAG DataTAG
NorduGrid NorduGrid NorduGrid NorduGrid NorduGrid
Globus GT2 GT3 GT4 GT4 GT4 GT4 GT4 GT4 GT4 GT4 GT4
LitGrid
BalticGrid

• Other Grid-related projects do not develop Open
  Source-like (i.e., free) software/middleware, as
  of today
• Legion/Avaki (Globus competitor)
• Entropia
• IBM, Platform Globus-based
• Sun Grid Engine EE enterprise Grids

19
Grid applications

• Computation intensive
• Interactive simulation (climate modeling)
• Very large-scale simulation and analysis (galaxy
  formation, gravity waves, battlefield simulation)
• Engineering (parameter studies, linked component
  models)
• Data intensive
• Experimental data analysis (high-energy physics)
• Image and sensor analysis (astronomy, climate
  study, ecology)
• Distributed collaboration
• Online instrumentation (microscopes, x-ray
  devices, etc.)
• Remote visualization (climate studies, biology)
• Engineering (large-scale structural testing,
  chemical engineering)

20
Lithuanian GRID - LitGrid

• Started on 2005.07.01
• Funded by Lithuanian State Science and Studies
  Foundation
• Budget 100.000 Lt (2005)
• Middleware LCG-2 (from EGEE project)
• Operating system for site level Scientific
  Linux
• Clusters will be tested according to EGEE
  procedures
• CA procedures will follow those of BalticGrid
  (BalticGrid CA is already registered at EU Grid
  PMA Eurpoean Policy Management Authority for
  E-science)
• VOs will be also integrated with EGEE and
  BalticGrid
• Website www.litgrid.lt

21
LitGrid partners

• Vilnius University (coordinator)
• Kaunas University of Technology
• Vilnius Gediminas Technical University
• Institute of Theoretical Physics and Astronomy
• Institute of Physics
• Institute of Mathematics and Informatics
• Vytautas Magnus University
• Institute of Biotechnology
• Institute of Psychophysiology and Rehabilitation
• the BGM company
• Klaipeda University, Šiauliai University

22
LitGrid goals

• To develop the research and education computing
  and communication infrastructure in Lithuania,
• To integrate this infrastructure into the
  emerging European Grid and Baltic Grid
  infrastructure,
• To bring the knowledge in grid technologies and
  use of grids in Lithuania to a level comparable
  to that in EU members states with a longer
  experience in the development, deployment and
  operation of grids,
• Further engage Lithuania in policy and standards
  setting activities.

23
LitGrid applications

• Modeling of heterogeneous systems and processes
  in biology and biochemistry
• Topics in material science (Gamess group)
• Energy spectra and hyperfine structure of atoms
  and ions
• Modeling of free and two sided surfaces
• Powder dynamics
• Embeded systems
• Analysis of biological macromolecules
• 3D visual data mining

24
LitGrid infrastructure
CE, SE pupa.elen.ktu.lt
R-GMA (Grid Monitoring)
RB, BDII grid3.mif.vu.lt
BalticGRID CA
25
BalticGrid project

• Partners
• 10 Leading institutions in six countries in the
  Baltic Region and Switzerland (CERN)
• Budget
• 3.0 M
• Coordinator
• KTH PDC, Stockholm
• Compute Resources
• 17 resource centres
• Duration
• 30 Months
• Started 1 November 2005

SA - Specific Service Activities NA - Networking
Activities JRA - Joint Research Activities
26
BalticGrid Objectives

• Sustainable integration of the research and
  educational computing and communication
  infrastructure in the Baltic States into the
  European Grid infrastructure.
• Enable the formation of effective research
  collaborations in the Baltic States, within
  Europe and beyond.
• Enabling an efficient sharing of unique
  instruments and data, as for instance
  environmental data related to the Baltic Sea.

27
BalticGrid Partners

• Estonia
• Tallinn, Tartu
• Lithuania
• Vilnius
• Latvia
• Riga
• Poland
• Kraków, Poznan
• Switzerland
• Geneva
• Sweden
• Stockholm

28
BalticGrid Activities

• Networking Activities
• NA1 Management of the I3
• NA2 Education, Training, Dissemination and
  Outreach
• NA3 Application Identification and Support
• NA4 Policy and Standards Development
• Specific Service Activities
• SA1 Baltic Grid Operation
• SA2 Network Resource Provisioning
• Joint Research Activity
• JRA1 Account Service Level Agreements, Markets
  and Dynamic Account Management

29
BalticGrid applications

• High-Energy Physics (statistical data analysis,
  Monte Carlo simulation)
• Material Sciences (atomic and molecular
  structures, solid state surfaces, photon and
  electron interactions)
• Bioinformatics (sequence pattern discovery,
  modeling of biosensors)
• Special interest groups (SIG, on Baltic Sea
  eco-system or Baltic Sea Marine Research,
  E-Health, etc.)
• Application Support (application adaptation
  experts, deployment of Migrating desktop)

30
Use Targets
Target Project month 12 Project Month 24 Project Month 30
Number of Users 40 100 150
Number of Disciplines 3 10 15
Number of Application Codes 3 6 20
Number of International Collaborations 10 20 40
Number of Compute hours per Year 1 x 106 2 x 106 4 x 106
31
Summary

• Lithuanian Grid (LitGrid) and BalticGrid is the
  good possibility for collaboration between
  Universities and academicals institutions of
  Baltic States.
• LitGrid and BalticGrid is open for new users,
  resources, application developers and ideas.