NPACI All Hands Meeting

1
Grid Portals Tutorial

• Catherine Mills
• Kurt Mueller
• Maytal Dahan

2
Goal of Tutorial
Participants should leave knowing how to use
Gridport to develop a portal.

• Basic set of Grid Tools
• How to install tools and setup environment
• How to write a portal

3
Target Audience

• Portal Programmers who have
• A Basic Understanding Grid Tools
• Basic Perl Skills

4
Tutorial Outline

• Part I Catherine Mills (SDSC)
• Portals and Grid Tools Overview
• Part II Kurt Mueller (SDSC)
• Grid Tools Installation Procedures
• Part III Maytal Dahan (TACC)
• Gridport Installation and API

5
Grid Portals Overview

• Catherine Mills
• cmills_at_sdsc.edu
• San Diego Supercomputer Center

6
Outline

• portals existing at SDSC
• Gridport Architecture
• Grid Tools
• Globus
• MyProxy
• SRB
• Perl Cog/Gridport

7
Types of Grid Portals

• Informational
• Data
• Application

8
Informational

• Supply up to date information about resources in
  a user friendly format
• Example HotPage

9
Informational
10
Data Portals

• Assist users in managing large amounts of data
• Data may or may not be distributed
• Example Cosmic

11
Data Portals (Cosmic)
12
Application Portals

• Assist users of a specific application with
  running that application.
• Example Gamess

13
App. Portal(Gamess)
14
Outline

• portals existing at SDSC
• Gridport Architecture
• Grid Tools
• Globus
• MyProxy
• SRB
• Perl Cog/Gridport

15
Gridport Architecture

• Perl API for CGI programming
• Grid Tools for remote access to resources

16
Outline

• portals existing at SDSC
• Gridport Architecture
• Grid Tools
• Globus
• MyProxy
• SRB
• Perl Cog/Gridport

17
Grid Tools

• The goal of this portion of the tutorial is to
  familiarize you with vocabulary and basic
  functionality of Grid Tools

18
Globus

• Get Information on Globus at
• http//www.globus.org
• Recommended ReadingQuick Start Guide
• http//www.globus.org/toolkit/documentation

19
Globus

• Resource Management (Gram)
• Information Services (GIS)
• Access to Remote Data (GASS)
• Security (GSI)

20
GRAM - Grid Resource Allocation Manager
21
GRAM

• Run Jobs
• Stage Files
• Run executables
• Submit batch jobs
• Manage Jobs
• Checking, Killing, Retrieving, and Cleaning

22
GRAM

• globus-job-run
• Runs a remote job in the foreground
• globus-job-submit
• Submits a job to the scheduler
• globusrun
• Executes script written in RSL on remote machine
• Both of above are implemented in RSL

23
RSL

• Globus Resource Specification Language
• Example
• Globus-job-run hostname.edu \
• /bin/echo Hello, Globus world.
• In RSL
• (executable/bin/echo)
• (argumentshello, Globus world.)
• Example taken from quick start guide

24
GIS Grid Information Services

• More Information
• http//www.globus.org/mds

25
GIS

• Monitoring and Discovery Service (MDS)
• Uses information providers to supply information
  to ldiff scheme
• Comes with basic set of information providers

26
GIS

• GRIS Grid Resource Information Service
• GIIS Grid Index Information Service

27
GASS Globus Access to Secondary Storage

• C API
• Command Line Programs
• File Transfer
• 3rd Party Transfer

28
GSI Authentication

• CA Certificate Authority
• Globus
• Sdsc
• Thawte, verisign
• Certificate
• Key
• Proxy

29
GSI

• Certificate username/.globus/usercert.pem
• Key
• username/.globus/userkey.pem

30
GSI

• DN distinguished name
• Grid map file
• Create a Proxy
• grid-proxy-init

31
Outline

• portals existing at SDSC
• Gridport Architecture
• Grid Tools
• Globus
• MyProxy
• SRB
• Perl Cog/Gridport

32
MyProxy

• Tool for managing your credentials
• http//www.ncsa.uiuc.edu/Divisions/ACES/MyProxy

33
MyProxy

• Server Secure machine managed by Security
  knowledgeable Administrator
• Client Tools
• Create and upload proxy to server
• Lives 7 days - then must repeat
• Request delegation from server

34
MyProxy - why is this useful?

• Save credentials in single location
• Create proxy and put in myproxy
• Obtain that proxy from any location
• Very Useful to portals for login

35
Outline

• portals existing at SDSC
• Gridport Architecture
• Grid Tools
• Globus
• MyProxy
• SRB
• Perl Cog/Gridport

36
Storage Resource Broker (SRB)

• Simplifies managing large distributed data sets
• http//www.npaci.edu/DICE/SRB

37
What is SRB?

• A distributed file system (Data Grid), based on a
  client-server architecture.
• It provides a way to access files and computers
  based on their attributes rather than just their
  names or physical locations.
• It replicates, syncs, archives, and connects
  heterogeneous resources in a logical and
  abstracted manner.

38
SRB
39
The BIRN SRB Data Grid
http//www.nbirn.net/
40
Outline

• portals existing at SDSC
• Gridport Architecture
• Grid Tools
• Globus
• MyProxy
• SRB
• Perl Cog/Gridport

41
Perl Cog

• Set of Perl Modules
• Provides an perl API to the above tools

42
Gridport

• Provides an API for writing web portals
• Helps with authentication