The Scaling and Validation Programme PoC

1
The Scaling and Validation Programme PoC

• David Groep vle-pfour-team
• VL-e Workshop 2005.04.05
• NIKHEF
• SARA
• LogicaCMG
• IBM

2
PoC ToC

• What is the Scaling and Validation Program?
• Activities in the SV programme
• Environments infrastructure
• Rapid Prototyping environment
• Certification test bed
• PoC stable systems
• Need Help?

3
Positioning of the PoC in VL-E
Application specific service
Medical Application
Telescience
Bio ASP
Application Potential Generic service
Virtual Lab. services
Virtual Lab. rapid prototyping (interactive
simulation)
Virtual Laboratory
Additional Grid Services (OGSA services)
Grid Middleware
Grid Network Services
Network Service (lambda networking)
Surf net
VL-e Proof of concept Environment
VL-e Experimental Environment
4
Scaling Validation (SV) Aims

• Build environments for experimentation
• different scales, with a variety of resources
• stable quasi-production Proof-of-Concept (PoC)
• Support applications
• stable, but also extend (and improve)
  continuously
• deploy VL software and components from elsewhere
• Disseminate knowledge about them
• tutorials, events, helpdesk
• Learn ourselves from the deployment
• close the cycle, improve with developers and
  users
• SV needs applications for a realistic workload

5
Three activity tracks

• Software engineering a timeline
• Rapid Prototyping
• basic research evaluating innovative ideas
• ? Certification
• quality control and engineering process Ronald S
• testing Chris Schotanus
• ? PoC
• stable environment for application development
• common base for incremental development
• Deploying a national-scale infrastructure
• Dissemination and knowledge import

6
Implementation the process
PoC Release n
Release Candidaten1
Developers environment
Stable, reliable, tested Cert. releases Grid MW
VL-software
Flexible, test environment
Characteristics
Flexible, unstable
Virtual Lab. rapid prototyping (interactive
simulation)
Test Cert. Grid MW VL-software Compatibility
Integration tests Functionality tests Adventurous
application people
Application development
Usage
NL-Grid production cluster Central mass-storage
facilitiesSURFnet
NL-Grid Fabric Research Cluster
DAS-2, local resources
Initial compute platform
Rapid Prototyping Environment
VL-e Rapid Prototyping Environment
Environments
VL-e Certification Environment
VL-e Proof of Concept Environment
Tagged Release Candidates
Download RepositoryPoC InstallerCluster Tools
Developer CVSNightly buildsUnit tests
stable, tested releases
7
Rapid Prototyping Environment

• Central services DAS-2 distributed clusters
• VU, UvA, Leiden, TUDelft, Utrecht
• Specific services
• database servers (Oracle, Matisse) integrated in
  UvA DAS-2 cluster1.3 TByte storage available.
• core VL services on dedicated nodes
• Local systems
• Your own workstations, test clusters c.

8
Certification test bed

• Smallish setup to validate new releases
• core 10 node dual-CPU cluster
• some test disk space (as needed)
• extensible with many more systems
• Characteristics
• highly flexible
• but managed the same as the real thing
• same network/typology constraints
• validate release n1 of the PoC s/w suite

9
P4CTB configuration via Quattor

• Managed software
• know exactly what is installed where
• central configuration control (via Quattor)
• higher availabilityre-assign nodes on demand to
  stand in for failures capacity problems
• flexible environmentcan run older versions
  on-demandreinstalls in 15 min including grid
  software configuration!
• Same system is used for real PoC

10
PoC Resources and systems

• Central resource sites today
• SARA NCF NL-Grid Matrix cluster
• SARA Storage (Teras), SRB Matrix
• NIKHEF NDPF LCG2PROD NCF GFRC
• IBM in preparation
• User Help Needed? SARA can get you
  up-and-running.
• Access node install via PoC Installer
• keep pressing enter and you get there
• Supported OSs
• RedHat Enterprise 3 clones (CentOS, SL)
  (legacy support RedHat 7.3)

Subject to change coordinated and managedwith
fixed cut-ff dates (timeboxed)
11
Dissemination Support

• Core Grid and GT2 tutorials
• Hands-on web services eventGrid Admin Nerd
  Group (GANG)
• mmv.
• User help-desk for the PoC? [phone] and
  grid.support_at_sara.nl
• Technology pilots Storage Resource Broker,

12
Summary

• Infrastructure the PoC is there for you
• hardware, Grid software, DBs, VLAM-G s/w
• Software engineering HEAR ALL ABOUT IT IN THE
  NEXT TWO TALKS
• Support and dissemination
• type of support, tools,
• we could take the PoC to your site (if you want
  to)
• work together on common central services you need

13
Contacts

• Reach all of us at
• vle-pfour-team_at_sara.nl
• poc.vl-e.nl
• or via the internal web site
• Other contact addresses
• davidg_at_nikhef.nl services, PoC, web,
  PoC-installer
• ronalds_at_nikhef.nl certification, testing,
  tooling,
• maurice.bouwhuis_at_sara.nl PoC_at_SARA, SRB pilot,
• grid.support_at_sara,nikhef.nl user questions