The Contribution of OMIIEurope towards Standardbased Grid Middleware

1
The Contribution of OMII-Europe towards
Standard-based Grid Middleware

• Dr. Sergio Andreozzi, INFN-CNAF, Italy
• sergio.andreozzi_at_cnaf.infn.it
• NorduGrid 2007, 24 Sep 2007, Copenhagen, Denmark

2
Outline

• What is OMII-Europe
• Facts
• Vision and Mission
• Approaches to Interoperability
• What OMII-Europe is Doing
• Strategies for Short and Medium Term Evolution

3
What is OMII-Europe

• OMII-Europe stands for
• Open Middleware Infrastructure Institute for
  Europe
• It is an EU-funded project FP6, RI
• It has an initial duration of 2 years
• May 2006 -gt April 2008
• It has been granted a contribution of 8M
• It involves 16 partners
• 8 EU
• 4 USA
• 4 China

4
Partners
5
Project Structure and Effort Allocation

• Networking activities
• Management, Outreach, Training
• 8 Person Effort
• Service Activities
• Repository, QA, Support
• 25 Person Effort
• Joint Research Activities
• Re-engineering, new services, integration,
  benchmarking
• 67 Person Effort

6
Vision

• e-Science having
• easy access and use
• of Grid resources
• in heterogeneous
• e-infrastructures
• crossing national,
• pan-European
• and global boundaries

7
Mission

• Enabling of
• e-infrastructure
• interoperability
• by providing
• standards-based
• middleware components
• leveraging existing work
• and activities

8
Focus

• Achieving interoperability through common
  standards
• Common standards is the long term solution
• Significant involvement and success in OGF and
  Oasis
• Implementations of standards in tandem with
  standards development on all middleware platforms

9
Approaches to Interoperability

• Adapters-based
• The ability of Grid middlewares to interact via
  adapters that translate the specific design
  aspects from one domain to another
• Standard-based
• the native ability of Grid middleware to interact
  directly via well-defined interfaces and common
  open standards

definition inspired by OGF GIN CG
10
Who Benefits from Interoperability?

• Grid Developers
• A single standard set of services on all Grid
  middleware systems
• Applications portable across different Grid
  middleware systems
• E-Science application users
• Common ways for accessing any e-infrastructure
  resources
• Potential access to a significantly larger set of
  resources
• E-resource owners
• Reduced management overheads as only a single
  Grid middleware system needs deployment
• Potential for greater resource utilisation
• For the Grid to deliver on its promises
  interoperability needs to be taken for granted
  like network interoperability

11
Participation in Middleware Standardisation

• Most project participants involved as
  member/observer in many OGF WG
• 11 project participant hold senior positions in
• OGSA DAIS WG (Database Access and Integration
  Services)
• OGSA RUS WG (Resource Usage Server)
• OGSA BES WG (Basic Execution Service)
• OGSA JSDL WG (Job Submission Description
  Language)
• GIN CG (Grid Interoperability Now)
• OGSA-AuthZ-WG (Authorization)
• GLUE WG
• GFSG WG (Grid File System)
• RM WG (Reference Model)
• OGSA Naming WG
• Technical Standards Committee
• GSA RG (Grid Scheduling Architecture)
• GRAAP WG (Grid Research Agreement Allocation
  Protocol)
• OGSA BYTE IO WG
• OGSA D WG (Data)
• OGSA DMI WG (Data Movement Interface)

12
OMII-Europe Guiding Principles

• Committed to standards process
• Implementing established open standards
• Providing feedback to the standards process (e.g.
  OGF)
• Quality Assurance
• Published methodology and compliance test
• All software components have public QA process
  and audit trail
• Impartiality
• OMII-Europe is honest broker providing
  impartial advice/information on e-infrastructures

13
The Virtuous Cycle Technology transfer with
Grid projects and standards organisations
Standards Compliance Testing and QA
JRA2
New Components
Standards Implementation
Components
JRA1
IN
Globus
Benchmarking
Repository
OUT
OMII-UK
Components
CROWN
Supported Components on Eval. Infrastructure
Integrated Components
14
What OMII-Europe is Doing?

• Initial focus on providing common interfaces and
  integration of major Grid software
  infrastructures
• Common interoperable services
• Database Access
• Virtual Organisation Management
• Accounting
• Job Submission and Job Monitoring
• Infrastructure integration
• Initial gLite/UNICORE/Globus interoperability
• Interoperable security framework
• Access these infrastructure services through a
  portal

15
Job Submission

• Unify Job Submisson and Monitoring interface
• Adoption of emerging OGSA-BES and JSDL standards
• Alpha BES and JSDL implementations for
• UNICORE 6, gLite 3.1, Globus 4, OMII-UK,
  CROWNgrid
• Interoperability demonstrated through use of a
  BES compliant meta-scheduler

16
VO Management

• To provide a common Virtual Organisation (VO)
  management solution across middleware
  distributions
• Extend VOMS Interface to support emerging AuthZ
  standard
• compliance with SAML Authorisation model
• Extension, not a replacement interface
• Public release of VOMS integrated with UNICORE

17
Accounting

• Unify accounting information across middleware
  distributions
• Provide standardized interfaces for accessing
  that information
• Information standard
• Usage Record Format (URF)
• Service interface standard
• Resource Usage Service (OGSA-RUS)
• Alpha versions RUS
• gLite (DGAS)
• Globus (SGAS)
• UNICORE

18
Data Access

• Port OGSA-DAI 3.0 from Globus to other middleware
  distributions available throughout Europe and
  China
• UNICORE
• gLite
• CROWN

19
Portal

• Deliver tools for developing Grid portals and
  support for key Web and Grid standards and
  technologies
• Objectives
• Develop gateway to OMII Evaluation Infrastructure
• Develop tools for portal and grid software
  training
• Explore new approaches for grid portal
  development

20
Repository of Open-Source Software

• Make available software reengineered within
  OMII-Europe and contributed by third parties
• Single services/tools complete distributions
• Provide an interface to select software from the
  repository based on user requirements
• By capability/standards/provider/
• Support the upload, download and installation of
  the software
• Document platform portability pre-requisites
• Verify the software through compliance metrics
  tests

21
Behind the Repository

• Leverage existing infrastructure projects
• ETICS
• Capture build test configuration data for
  repeatability
• NMI Build Test Framework
• Manage cross-platform environment for build
  tests
• Condor
• Underlying execution infrastructure
• Provides reports to be displayed within the
  portal
• Builds Pre-requisites platforms
• Testing Conformance Interoperability

22
Tests For Standards Conformance

• Job Submission and Job Monitoring
• Job Submission Description Language (JSDL)
• Basic Execution Service (BES)
• Accounting
• Usage Record (UR)
• Resource Usage Service (RUS)
• Database Access
• WS-DAI, WS-DAIX, WS-DAIR (OGSA-DAI)
• Virtual Organisation Management
• Move towards SAML2?

23
New Services Activity

• To identify capabilities which are missing from
  the OMII-Europe initial plans
• To identify priorities for the placement of such
  capabilities
• To work for the inclusion of the most relevant
  missing capability during the 2nd year of the
  project (May 2007-Apr 2008)
• To drive the definition of OMII-Europe II

24
The First Missing Piecea Community-agreed
Information Model for Computing Resources

• OGSA-BES and JSDL are already considered by
  OMII-Europe
• They lack a common description of Grid resources
  suitable for discovery, monitoring and scheduling
• Many descriptions exist
• e.g. GLUE Schema, NorduGrid Schema
• Working on the definition of next-generation GLUE
  Information Model in the context of OGF GLUE WG
  and its implementationIt

25
What can you do Now and Later

• Now
• Most products at Alpha stage not publicly
  available
• They provide basic interoperability of multiple
  grid middleware systems focusing on job execution
• Available to early adopters working with
  OMII-Europe partners
• Spring 2008 (end of current project)
• Further security integration work between
  different middleware platforms
• Completed QAd services and demonstrated
  end-to-end solutions
• Availability of GLUE 2 information model service
  implementations

26
OMII-Europe Phase II

• In order to cover other important missing pieces,
  a proposal for a project follow-up was submitted
  last week
• The areas of interest are
• Service discovery
• Data Management
• Grid Activity Management
• Authorization Service
• Billing and Pricing

27
Important Events

• Interoperability demos at Supercomputing 2007
• International Grid Interoperability and
  Interoperation Workshop 2007 (IGIIW 2007)
• Bangalore, India, December 10-13, 2007
• in conjunction with 3nd IEEE International
  Conference on e-Science and Grid Computing
  (e-Science 2007)
• http//omii-europe.org/OMII-Europe/igiiw2007.html

28
And also available now and ongoing

• A number of training courses to date giving hands
  on experience of middleware systems, and
  interoperable services
• http//training.omii-europe.org
• Evaluation infrastructure and support available
  to try out different middleware systems and
  interoperable services
• http//support.omii-europe.org

29
Summary (1/2)

• OMII-Europe is a 24 Month EU funded project with
  16 partners to establish grid infrastructure
  interoperability through implementing a set of
  agreed open standards on all middleware platforms
  
• OMII-Europe is implementing a number of
  components that will allow identically specified
  jobs to be run, managed and migrated to different
  middleware platforms
• Initial versions of BES, VOMS/SAML and security
  service have already enabled UNICORE and gLite
  managed resources to be used by the same job
• A complete set of fully interoperable services
  will be available in spring 2008

30
Summary (2/2)

• Users can try interoperability on the OMII-Europe
  evaluation infrastructure, or obtain services for
  installation on their own resources from the
  OMII-Europe repository
• We anticipate OMII-Europe services to be
  integrated into standard middleware distributions
  as well as deployed on large scale
  e-infrastructures such as EGEE and DEISA
• OMII-Europe requested continuing funding in the
  September EU call to support the existing
  services and provide further services in the
  areas of data and Grid management

31
Further Information

• http//omii-europe.org