Grid Computing Test beds in Europe and the Netherlands

1
Grid Computing Test bedsin Europe and the
Netherlands

• David Groep, NIKHEF2001-10-01

2
Resource access then now

• In ye olde days (till approx 1992)
• Hardly any network security
• All machines in a local net were created equal
• All local users happy with remote shell, rlogin,
  rcp
• Now
• Want to communicate globally over Gigabit WAN,
  but
• Internet is full of firewalls and barriers,to
  retain local control and keep crackers out
• The Grid
• Bring back single sign on and trust
• use the WAN as the 80s LANs all global users
  happy

3
What is Grid computing?

• Dependable, consistent and pervasive access to
  (high-end) resources
• Combine resources from various organizations
• User-based view Virtual Organizations
• Transparent decisions for the user
• Security is of paramount importance
• Authentication, Authorization, AccountingQuota

4
The One-Liner

• Resource sharing and coordinated problem solving
  in dynamic multi-institutional virtual
  organisations

5
Virtual Organizations
6
Grid Architecture
Make all resources talk standard
protocols Promote interoperability of application
toolkit, similar to interoperability of networks
by Internet standards
7
Grid Middleware

• Globus Project started 1997
• de facto-standard
• Reference implementation of Gridforum standards
• Large community effort
• Basis of several projects, including EU-DataGrid
• Toolkit bag-of-services' approach
• Successful test beds, with single sign-on, etc

8
Single Sign-on

• Based on PKI (Public Key Infrastructure), using
  X.509 certificates
• Grid Credential Name (login name for the Grid)
• Private key, for signing and encryption
• Certificate signed by trusted third parties
  (CAs) (see http//certificate.nikhef.nl/)
• Co-operates with local security policies
• Exchange certificates, authenticate, delegate
• Limit vulnerability by using limited proxies

9
Looking at Resources

• Per Virtual Organization (or test bed)
• Directory of Resources and their
  Characteristics
• Used to find best resource out there
• DataGrid httap//marianne.in2p3.fr/
• DutchGrid?ldap//giishost.nikhef.nl30001/

10
Submitting a Job
11
Sending your Data

• Tape robots, disks, etc. share GridFTP interface
• Optimize for high-speed gt1Gbit/s networks
• In the future automatic optimizations,
  bandwidth reservations, directory-enabled
  networking,

12
EU DataGrid Work Packages
13
EU DataGrid Test bed 1

• DutchGrid embedded in
• DataGrid Test bed 1
• DataGrid TB1
• 14 countries
• 21 major sites
• Shared PKI
• Mutual authorization
• Major applicationsHEP, Earth Obs,Bio-informatic
  s

14
DutchGrid platform

• DutchGrid aims
• Share experience
• Test bed coordination
• PKI security
• Participation by
• NIKHEFFOM, VU, UvA, Utrecht, Nijmegen
• KNMI, SARA
• AMOLF
• DAS (ASCI)TUDelft, Leiden, VU, UvA, Utrecht
• Telematics Institute

15
DutchGrid build-up now

• Current startup-resources to be abused
• NIKHEF
• 50x2 CPUs D0 cluster
• 2x10x2 (40) CPUs LHCb at NIKHEF(WCW) VU
• 10x2 CPUs Alice NIKHEF(WCW)
• ca. 4x2 CPUs Alice Utrecht
• ca. 10x2 CPUs D0 Nijmegen
• Lots of disk dedicated 1.3TByte cache server
• DAS-II 200 dual-PIIIs systems some disk
  (2TByte)
• Spread over 5 locations (NIKHEF is one!)
• SARA tape robot (gt200TByte), some clusters

16
Present and Future

• Plenty more systems ( 5000 CPUs in 2003/4??)
• Mass storage (_at_SARA)
• Network capacity to CERN and Fermi (SURFnet)
• Buildup of software infrastructure
• Support for changing Analysis/MC software
• Bringing the Grid to the (interactive) Desktop