GLOBUS Toolkit - Grid Deployment

1
GLOBUS Toolkit -Grid Deployment

• Boro Jakimovski
• Marjan Gusev
• Institute of Informatics
• Faculty of Natural Sciences and Mathematics
• University of Sts. Cyril and Metodius
• Skopje, Macedonia

2
Grid technology

• Flexible, secure, coordinated resource sharing
  among dynamic collections of individuals,
  institutions, and resource
• Grid architecture
• Defined using services and protocols
• Using the sand hourglass model similar to the
  TCP/IP protocol stack
• From The Anatomy of the Grid Enabling Scalable
  Virtual Organizations

3
Grid architecture

• Fabric resource specific operations
• Connectivity main communication and
  authentication proto.
• Resource usage, monitoring, control of single
  resource
• Collective global interactions between
  collections of resources

4
Globus Toolkit

• No official Grid standards exist
• but
• Globus Toolkit has emerged as the de facto
  standard for several important Connectivity,
  Resource, and Collective protocols

5
Fabric

• Contains
• Computational resources
• Storage resources
• Network resources
• Code resources
• Catalogs

• Globus toolkit
• defined by vendor-supplied interfaces not
  physical characteristics
• enquiry software for detection of capabilities
  and delivers this information to higher lever
  services

6
Connectivity

• Contains services allowing
• Communicaion
• Transport
• Routing
• Naming
• Authentication
• Single sign on
• Delegaion
• Integration with local security solutions
• User-based trust relationships

• Globus toolkit
• Communication
• TCP/IP
• Authentication
• GSI Grid Security Infrastructure
• TLS Transport Layer Security protocols
• X.509 certificates
• User-based trusts
• GAA Generic Authorization and Access interface
• Helps integration with local policies

7
Resource

• Contains services for
• Information structure and state of the resource
• Management negotiate access, perform
  operations, accounting

• Globus toolkit
• GRIP(S) Grid Resource Information Protocol
  (Service)
• Based on LDAP
• GRRP Grid Resouce Registration Protocol
• GRAM Grid Resource Access and Management
  protocol
• GridFTP
• Uses sercurity protocols

8
Collective

• Contains global Grid services
• Directory services
• Co-allocation, scheduling
• Monitoring
• Data replication
• Grid-enabled programming systems
• Workload management
• Software discovery
• Community authorization
• Accounting

• Globus toolkit
• GIIS Grid Information Index Server
• DUROC co-allocator
• MPICH-G2

9
Globus Toolkit components

• Security
• GSI Grid Security Infrastructure
• Resource Management
• GRAM Grid Resource Allocation Manager
• globusrun
• RSL
• gatekeeper
• job manager
• DUROC Dynamically-Updated Request Online
  Coallocator
• Information Services
• MDS Monitoring and Discovery Service
• GRIS Grid Resource Information Service
• GIIS Grid Index Information Service
• MDS Client
• Data Management
• GridFTP
• GASS

10
GSI example
User
Site A (Kerberos)
Site B (Unix)
Computer
Computer
Site C (Kerberos)
Storage system
11
Globus Toolkit installation

• Choose packages (Client/Server/SDK)
• Source packages
• Binary packages
• Extra packages
• GPT Globus Packaging Tool
• Used for install/build disrtibution packages
• gpt-install ltoptionsgt ltpackage-namegt ltflavorsgt
• gpt-build ltoptionsgt ltpackage-namegt ltflavorsgt
• gpt-postinstall

12
Globus Toolkit packages
Package Flavor
Data Management Client gcc32dbg
Data Management SDK gcc32dbg
Data Management Server gcc32dbg
Information Services Client gcc32dbgpthr
Information Services Server gcc32dbgpthr
Information Services SDK gcc32dbgpthr
Resource Management Client gcc32dbg
Resource Management SDK gcc32dbg
Resource Management Server gcc32dbg
Replica gcc32dbgpthr
GSI gcc32dbg
13
Globus Toolkit installation

• After deploying the selected packages and running
  gpt-postinstall we execute
• setup-gsi configures grid serurity
• In order to use the installation we need to
  acquire certificates
• user certificate
• grid-cert-request creates usercert-request.pem
• host certificate
• grid-cert-request host lthostnamegt creates
  host.req
• LDAP certificate
• grid-cert-request cn ldap/hostname creates
  server.req

14
Globus Toolkit installation

• Globus services installation
• In /etc/services insert
• Gsigatekeeper 2119/tcp Globus Gatekeeper
• gsiftp 2811/tcp GridFTP
• xinetd/globus-gatekeeper
• service gsigatekeeper
• socket_type stream
• protocol tcp
• wait no
• user root
• server GLOBUS_LOCATION/sbin/globus-gatekeeper
  
• server_args -conf GLOBUS_LOCATION/etc/globus-g
  atekeeper.conf
• disable no
• Similar for grid-ftp

15
Globus Toolkit verification

• To test the functionality of the gatekeeper
  execute
• grid-proxy-init -debug -verify
• globus-personal-gatekeeper start
• Starts personal proxy and returns our contact
  string
• hostname4589/OGrid/OGlobus/CNYour Name
• To execute a command we use
• globus-job-run ltcontactgt /bin/date

16
Globus Toolkit verification

• MDS test
• SXXgris start starts the GRIS/GIIS server
• grid-info-search -anonymous -L starts a test
  query to the local GRIS
• GridFTP test
• grid-proxy-init start the proxy
• in.ftpd -s -p 5678 start the ftp server
• globus-url-copy -s "grid-cert-info -subject
  gsiftp//localhost5678/tmp/file1
  file///tmp/file2

17
Globus Toolkit clients

• GRAM Clients
• globus-job-run online interface for job
  submition
• globus-job-run 'contact string' command
• globus-job-submit batch job submition
• globus-job-submit 'contact string' command
• globusrun executes a RSL script
• MDS Clients
• grid-info-host-search - client to a GRIS server
• grid-info-host-search -p port hostname "LDAP
  filter"
• grid-info-search - client to a GIIS server
• grid-info-search -x
• GridFTP Clients
• globus-url-copy
• globus-url-copy sourceURL destURL

18
RSL Example
( (resourceManagerContact
flash.isi.edu754/CUS//CNflash.isi.edu-fork)
(count1) (label"subjob A")
(executable my_app1) ) (
(resourceManagerContact
sp139.sdsc.edu8711/CUS//CNsp097.sdsc.edu-lsf
") (count2) (label"subjob B")
(executablemy_app2) )
19
CoG Community Grid

• CoG is a Java based Globus Toolkit interface. It
  can be used by normal users for easy access to
  the Grid.