OGSITestbed Project

1
GEMLCA Legacy code execution on top of
service-oriented Grids
Grid Execution Management for Legacy Code
Architecture
Peter Kacsuk Cavendish School of Computer
Science University of Westminster pkacsuk_at_wmin.ac.
uk
2
User concerns of Grid systems

• How to cope with the variety of these Grid
  systems?
• How to develop/create new Grid applications?
• How to execute Grid applications?
• How to observe the application execution in the
  Grid?
• How to tackle performance issues?
• How to port legacy applications
• to Grid systems
• between Grid systems?
• How to execute Grid applications over several
  Grids in a transparent way?

3
Generations of Grid Systems
Grid Systems
2nd Gen.
1st Gen.
Globus 2
Condor
3rd Gen.
OGSA/Globus 3/4
4
UK E-science OGSA Testbed

• test and evaluate OGSA/GT3 core
• evaluate performance, ease of deployment and use,
  and interoperability

University of Portsmouth University of
Westminster University of Manchester University
of Reading Daresbury, CCLRC University of
Southampton SZTAKI (Hungary)
5
Presentation Outline

• GEMLCA objectives
• Concept of GEMLCA
• Server side
• GEMLCA client the P-GRADE portal
• Deployment examples
• Conclusion future work

6
Obstacles of industrial take-up of Grid

• Problems with security
• Lack of business model
• Gridifying legacy applications

7
Legacy Applications

• Code from the past, maintained because it works
• Often supports business critical functions
• Not Grid enabled

What to do with legacy codes when utilising the
Grid?

• Bin them and implement Grid enabled applications

• Reengineer them

• Port them onto the Grid with minimal user effort

8
GEMLCA Grid Execution Management for Legacy
Code Architecture
Objectives

• To deploy legacy code applications as Grid
  services without reengineering the original code
  and minimal user effort
• To create complex Grid workflows where components
  are legacy code applications
• To make these functions available from a Grid
  Portal

GEMLCA
GEMLCA P-GRADE Portal Integration
9
Legacy applications in service-oriented
GridsGemlca PGrade portal approach thin client
P-GRADE Portal Server
10
Presentation Outline

• GEMLCA objectives
• Concept of GEMLCA
• Server side
• GEMLCA client the P-GRADE portal
• Deployment examples
• Conclusion future work

11
GEMLCA Concept
12
Gemlca security solutions

• GT3/GT4 standard solutions
• Authentication
• X509 user certificate
• Grid-map file
• Message security
• Single sign-on
• Gemlca service authorisation and LC access
  policies
• Who is allowed to deploy Grid-enabled legacy
  codes ?
• Global (Public) LC repository by GEMLCA
  administrator,
• Local (Private) user LC repository
• Who is allowed to use already deployed
  Grid-enabled legacy codes ?
• Public LC services can be accessed by any GEMLCA
  user
• Private LC services can be accessed by the owner

13
Presentation Outline

• GEMLCA objectives
• Concept of GEMLCA
• Server side
• GEMLCA client the P-GRADE portal
• Deployment examples
• Conclusion future work

14
GEMLCA at Server Side
Required GEMLCA Resources

• GT3.2 and GT4 are installed
• MMJFS tested
• Fork/Condor job manager
• Grid FTP running
• GEMLCA server package and Tomcat 4 installed
  downloadable from
• www.cpc.wmin.ac.uk/gemlca
• GEMLCA legacy code deployed

15
GEMLCA at Server Side
Legacy Code Deployment
Legacy code
LC service
16
Even more user-friendly legacy code deployment
Legacy code
LC service
17
Presentation Outline

• GEMLCA objectives
• Concept of GEMLCA
• Server side
• GEMLCA client the P-GRADE portal
• Deployment examples
• Conclusion future work

18
Integration of P-GRADE Grid Portal and GEMLCA
19
Gemlca Client in a nutshell in the P-GRADE portal
Proxy Management
20
Gemlca Client in a nutshell in the P-GRADE portal
Definition of GEMLCA Resources
21
Gemlca Client in a nutshell in the P-GRADE portal
Workflow Creation
UoW
Sztaki
UoR
22
Gemlca Client in a nutshell in the P-GRADE portal
Definition of Legacy Code Properties
23
Gemlca Client in a nutshell in the P-GRADE portal
Execution Visualisation
24
Deployment examples
Workflow to analyse road traffic
Manhattan road network generator
Traffic simulators
Analyser
25
Further examples

• GAMESS-UK
• Ab initio molecular electronic structure program
  for performing SCF-, DFT-, and MCSCF-gradient
  calculations using a variety of techniques for
  post Hartree-Fock calculations
• Developed by Daresbury Laboratory
• MultiBayes
• Phylogenetic Tree Construction
• Developed at the School of Animal and Microbial
  Sciences at University of Reading

26
GEMLCA/portal service for utility grids

• Goal Provide additional services like legacy
  code support for large production Grids
• UK National Grid Service
• EGEE Grid
• NorduGrid

27
The problem
28
The solution
29
Legacy applications in service-oriented
GridsGemlca PGrade portal approach thin client
P-GRADE Portal Server
30
Legacy applications in service-oriented
GridsGemlca PGrade portal approach thin client
P-GRADE Portal Server
31
The scenarios Scenario 1 legacy code repository
3rd party service provider (UoW)
GEMLCA resource (GT4 GEMLCA classes)
NGS site1 (GT2)
Workflow definition
NGS site2 (GT2)
P-Grade Portal
Central repository legacy code1 legacy
code2 . legacy coden
NGS siten (GT2)
user
job submission
32
Advantages of Scenario 1

• legacy codes can be uploaded into a central
  repository and made available for authorised
  users through a Grid portal
• would extend the usability of NGS as users
  utilise others legacy codes stored in the
  repository
• No support needed at the NGS sites

33
The scenarios Scenario 2 Legacy code services
NGS site1 (GT2)
Legacy codes
3rd party service provider (UoW)
Workflow definition
GEMLCA resource (GT4 GEMLCA classes)
NGS site2 (GT2)
Legacy codes
P-Grade Portal
user
NGS siten (GT2)
Legacy codes
Execution request
34
Advantages of Scenario 2

• extends the NGS Grid towards the service-oriented
  Grid concept
• Users can access the legacy codes that are
  deployed on the NGS sites
• NGS system administrators have full control of
  legacy codes that they deploy on their own
  resources

35
The implementation of scenario 1
36
The implementation
37
The implementation
2
38
The implementation
2
39
The implementation
2
40
The implementation
2
41
GEMLCA/P-GRADE Portal Status and Development
Roadmap
Nov. 2004
Jan. 2005
March 2005
May 2005
July 2005
U.Westminster
GEMLCA GT2 Release 1.0
GEMLCA GT4 Release 1.0
GEMLCA GT4 with security
GEMLCA GT3 Release 1.0
GEMLCA GT4 without security
Sep. 2004
March 2005
May 2005
P-GRADE Portal Release 1.0
SZTAKI
P-GRADE Portal Release 2.0
P-GRADE Portal Release 2.1
42
Conclusions

• GEMLCA enables the deployment of legacy code
  applications as Grid services with minimal user
  effort.
• GEMLCA is integrated with the P-GRADE portal to
  offer user-friendly development and execution
  environment.
• The integrated GEMLCA P-GRADE solution was
  successfully demonstrated using the traffic
  simulator and other applications

43
Thank you for your attention
Email gemlca-discuss_at_cpc.wmin.ac.uk Websites ww
w.cpc.wmin.ac.uk/gemlca http//www.cpc.wmin.ac.uk/
ngsportal