Living on the Edge: OSG Edge Services Framework

1
Living on the EdgeOSG Edge Services Framework

• Kate Keahey
• Abhishek Rana

2
Edge Services

• Services executing on the edge of the public and
  private network

ATLAS
CMS
SE
CE
CDF
Guest VO
Site
Compute nodes and Storage nodes
3
Edge Service Requirements

• Configuration Issues
• The configuration requirements can vary widely
  per Edge Service per community.
• We need an easy way to upgrade Edge Services
• Alternative Edge Services
• Resource allocation issues
• Flexibility in dynamically managing resource
  assignments as load demands fluctuate
• Fair usage between communities
• Incentives

4
Virtual Machines

• Excellent isolation, security, fine-grain
  forensics
• Promising enforcement properties
• More control to the site great recoverability
• Flexible configuration
• The ability to serialize and migrate
• Modern implementation are fast

5
Virtual Workspaces

• Virtual Workspaces environments that can be made
  available dynamically on the Grid
• Different possible implementations
• Workspace Service
• Enables secure deployment and management of a
  workspace within a trusted computing base
• Authentication and authorization
• Deployment configuration
• Resource allocation enforcement
• Workspace deployment meta-data image
• More information and technology preview download
  available at http//workspace.globus.org

6
Edge Service Framework
ESF - Phase 1
Edge Service Framework
Staging Tools
Workspace Service
Image Repository
Image Information
7
ESF - Phase 1
RoleVO Admin
CMS
ESF
SE
CE
Site
8
(No Transcript)
9
(No Transcript)
10
ESF - Phase 1
RoleVO Admin
ESF
SE
CE
Site
11
ESF - Phase 1
RoleVO Admin
ESF
CMS
SE
CE
Site
12
(No Transcript)
13
ESF - Phase 1
RoleVO Admin
Remote Entity
ESF
CMS
SE
CE
Site
14
(No Transcript)
15
(No Transcript)
16
(No Transcript)
17
(No Transcript)
18
ESF Project

• Phase 1 objective create a proof-of-concept
  dynamic deployment of Edge Services
• Progress
• Implement and release the Workspace Service
• Bubbly test static deployment and test of a real
  Edge Service on a production site
• Dynamic deployment of an Edge Service and
  integration into OSG infrastructure
• Configuring more testbeds
• Deploying and testing more Edge Services

19
Testbed Images

• Testbed
• SDSC (Abhishek)
• OSG production site, 150 worker nodes
• Intel 2.6, 4GB, RAID device, Xen 2.0.7
• FNAL (Burt)
• Xeon 3.2, 4GB, RAID device, Xen 2.0.7
• UC (Rob, Borja)
• TeraPort, Xen 3
• ANL, PIOCON coming online
• Images
• SDSC SL3.0.3, FC4, CentOS4.1
• FNAL SL3.0.3, SL4, LTS 3, LTS 4
• Edge Services
• ATLAS mysql-gsi db built by the DASH project

20
Summary

• Growing ESF testbed
• Xen capabilities / ESF requirements
• Installation woes getting worked out
• Growing library of images with useful
  configurations
• Growing infrastructure
• www.opensciencegrid.org/esf