Giovanni Aloisio [e-mail]

1
Web Access to the Gridusing theGrid Resource
Broker
University of Lecce, Italy

• Giovanni Aloisio giovanni.aloisio_at_unile.it
• Massimo Cafaro massimo.cafaro_at_unile.it
• Italo Epicoco italo.epicoco_at_unile.it
• Center for Advanced
• Computational Technologies

2
Outline

• Grid Portals
• The Grid Resource Broker (GRB)
• GRB Architecture
• GRB Services Overview
• GRB tools technologies
• GRB Security
• GRB Services in depth
• GRB libraries

3
Grid Portals
4
Grid Portals

• web sites providing specific contents and related
  services to the scientific community
• computational data grids as back-end
• potentially managing a large number of resources
  on behalf of the users

5
The GRB Portal

• User centric
• User friendly, ubiquitous web GUI
• Globus based, but
• No need to know Globus
• No need to write Globus code
• No need to rewrite legacy code
• C APIs will be released soon under the GNU Public
  License

6
GRB Architecture
7
Architecture
Third Tier
Grid resources
8
GRB Services
9
GRB Services 1

• Users profile management
• Access to Monitoring Discovery Services
• Job Submission
• Interactive
• Batch, with support for X-Windows apps
• Pararameter Sweep
• Data-Flow

10
GRB Services II

• Resource brokering
• Job tracking
• Grid Status
• High Performance File Transfers
• third-party
• parallel file transfer
• partial file transfer
• single file directory transfer

11
GRB technologies tools
12
GRB builds on the Globus Toolkit

• GSI
• MDS
• GRAM
• GridFTP

13
GRB technologies I

• C / Unix system calls
• Globus Toolkit v2.4
• HTML
• CGI
• MyProxy package
• TLS

14
GRB technologies II

• HTTP / HTTPS
• Ephemeral Cookies
• LDAP
• gSOAP
• GSI plugin for gSOAP

15
GRB Security
16
Security 1

• MyProxy package used to store retrieve
  short-lived users credentials
• HTTPS used to send users proxy pwd
• Sessions established via ephemeral cookies

17
Security II

• Cookies contain the following information
• Users login
• Timestamp
• Expiration date
• Message Authentication Code (MAC) for the
  previous data

18
Security III

• GRB uses the keyed, non-malleable MAC HMAC-SHA1
• it is computationally intractable to generate a
  valid ciphertext starting from a plaintext
  message related to a plaintext message with a
  known ciphertext. This key property guarantees
  that no adversary is able to generate a valid
  ciphertext without the knowledge of both the
  server secret key and the plaintext,
  independently of how many samples of valid
  plaintext and ciphertext pairs the adversary owns
• Cookies are encrypted with TLS
• GRB uses GSI

19
Authentication Authorization
Web
GRB
MyProxy, HTTPS Ephemeral Cookies
20
Authentication Authorization
21
GRB services in depth IUsers Profile Management

• Each user manages his/her grid by adding,
  removing and editing
• computational resources
• applications (work in progress)
• job submission sessions (work in progress)

22
GRB services in depth IIAccess to MDS (GIIS)
GRB
23
Allows queries to arbitrary GIIS
24
(No Transcript)
25
GRB services in depth IIIAccess to MDS (GRIS)
GRB
26
(No Transcript)
27
GRB services in depth IVInteractive Job Submit

• Interactive here means that the job output is
  sent directly back to the client browser
• Useful for little things such as listing the
  users home directory, browsing the contents of a
  file etc
• Support for automatic staging of executable
  and/or input files

28
(No Transcript)
29
GRB services in depth VBatch Job Submit

• Remote execution with support for automatic
  staging of executable, input and output files
• automatic redirection of X-windows display allows
  steering graphical apps
• simply starting an xterm allows writing, editing,
  compiling and debugging source code

30
(No Transcript)
31
GRB services in depth VI Parameter Sweep Jobs

• Allows remote execution on a user selected pool
  of machines of several instances of the same
  executable, each with a different input
• The pool of machine can also be automatically
  selected by the system (brokering)

32
(No Transcript)
33
GRB services in depth VII Data-Flow Jobs

• A simple Java applet allows drawing a DAG whose
  vertices represent batch jobs to be executed and
  whose edges models precedence constraints
• The data-flow engine schedules the jobs according
  to a topological sort of the DAG using a
  depth-first-search traversal

34
(No Transcript)
35
GRB services in depth VIIIResource Brokering
G
R
B
36
(No Transcript)
37
GRB services in depth IXJob Tracking

• Allows monitoring job status related file
  transfers for
• batch jobs
• parameter sweep jobs
• data-flow jobs (work in progress)

38
(No Transcript)
39
GRB services in depth XGrid Status

• Allows verifying that Globus daemons are up and
  running on the machines belonging to the users
  grid

40
(No Transcript)
41
GRB services in depth XIHigh Performance File
Transfers

• GRB library based on Globus GridFTP control
  library
• File/directory transfer status is monitored by
  GRB
• Supports third-party, parallel partial file
  transfers
• Very simple to use

42
(No Transcript)
43
GRB Libraries
Almost ready to be released under GNU Public
license
44
GRB libraries lib_grb

• Proxy management
• Job submission
• File transfer
• Monitoring Discovery Services
• Job status

45
GRB libraries lib_cookies

• cookie setup
• cookie encryption
• retrieving cookie information

46
GRB libraries lib_dataflow

• DAG management
• DAG topological sort

47
GRB libraries lib_myproxy

• proxy retrieval
• checking if a proxy is valid

48
GRB libraries lib_gsiftp

• Connection management
• Standard FTP commands
• Third-party transfers
• Parallel transfers using multiple streams
• Partial file transfers
• Support for directory transfers

49
lib_gsiftpexperimental testbed
Country Hostname OS TCP buffer size
gridsurfer.unile.it linux 2.4.3 65535
dev04.hepgrid.clrc.ac.uk linux 2.2.16 65535
clipper.lbl.gov solaris 2.7 65535
50
lib_gsiftpexperimental results I
Put one MB file test
From Italy to UK
From Italy to California
51
lib_gsiftp experimental results II
Put ten MB file test
From Italy to UK
From Italy to California
52
lib_gsiftp experimental results III
Third-party transfer one, ten and one hundred MB
files
From UK to California
53
Conclusions
54
To Do... In Progress

• Migration to GT3, OGSA OGSI
• Better HCI
• GridLab GridSphere Portlet Framework
• support for customization
• logging
• additional support for job scheduling/checking

55
More Information

• The Grid Resource Broker
• http//sara.unile.it/grb
• Giovanni Aloisio
• giovanni.aloisio_at_unile.it
• Massimo Cafaro
• massimo.cafaro_at_unile.it
• Italo Epicoco
• italo.epicoco_at_unile.it

56
References

• G. Aloisio, M. Cafaro , C. Kesselman, R.
  Williams, Web Access to SuperComputing using the
  Grid, IEEE Computing in Science and engineering,
  Volume 3 Number 6 (2001), pp. 66-72
• G. Aloisio, M. Cafaro, I. Epicoco, E. Blasi, The
  Grid resource Broker, a ubiquitous grid computing
  framework, Journal of Scientific Programming,
  Volume 10, Number 2 (2002), pp. 113-119, Special
  Issue on Grid Computing, IOS Press, Amsterdam
• G. Aloisio, M. Cafaro, Web-based access to Grid
  using the Grid Resource Broker, Concurrency and
  Computation Practice and Experience Journal,
  Volume 14 Issue 13-15 (2002), pp. 1145-1160,
  Special Issue on Grid Computing Environments.
• G. Aloisio, M. Cafaro, I. Epicoco, Early
  experiences with the GridFTP protocol using the
  GRB-GSIFTP library, Future Generation Computer
  Systems journal, Volume 18, Number 8 (2002), pp.
  1053-1059, Special issue on Grid Computing
  Towards a New Computing Infrastructure
• G. Aloisio, M. Cafaro, D. Lezzi, The Desktop
  Grid Environment Enabler, Computing and
  Informatics, Volume 21, Number 4 (2002), pp.
  333-345, Special Issue on Grid Computing
• G. Aloisio, M. Cafaro, P. Falabella, C.
  Kesselman, R. Williams, Grid Computing on the
  Web using the Globus Toolkit, Proc. HPCN Europe
  2000, Amsterdam, Netherlands, Lecture Notes in
  Computer Science, Springer-Verlag, N. 1823, pp.
  32-40, 2000
• G. Aloisio, M. Cafaro, E. Blasi, L. Depaolis, I.
  Epicoco, The GRBLibrary Grid Programming with
  Globus in C, Proc. HPCN Europe 2001, Amsterdam,
  Netherlands, Lecture Notes in Computer Science,
  Springer-Verlag, N. 2110, pp. 133-140, 2001
• G. Aloisio, M. Cafaro, D. Lezzi, R. Van Engelen,
  "Secure Web Services with Globus GSI and gSOAP",
  to appear in proceedings of Euro-Par 2003, 26th -
  29th August 2003, Klagenfurt, Austria

57
Q A