les robertson cernit 1

1
LHC Computing Grid Project - LCG

• The LHC Computing Grid
• First steps towards a
• Global Computing Facility for Physics
• PPARC Council Visit to CERN
• 12 December 2003
• Les Robertson LCG Project Leader
• CERN European Organization for Nuclear Research
• Geneva, Switzerland
• les.robertson_at_cern.ch

2
LHC DATA
The LHC Accelerator
This is reduced by online computers that filter
out around 100 good events per sec.

• The LHC accelerator
• the largest superconducting installation in the
  world
• 27 kilometres of magnets cooled to 300o C
• colliding proton beams at an energy of 14 TeV

The accelerator generates 40 million particle
collisions (events) every second at the centre of
each of the four experiments detectors
15 PetaBytes/year
Which are recorded on disk and magnetic tapeat
100-1,000 MegaBytes/sec
Accumulating a vast data base
3
Challenge 1 Data Volume
Data accumulating at 15 PetaBytes/year Recording,
management, processing
4
Challenge 2 Large, distributed community
Offline software effort 1000 person-yearsper
experiment
CMS
ATLAS
Software life span 20 years
LHCb
5000 Physicistsaround the world
5
LHC data analysis

• Reconstruction transform signals from the
  detector to physical properties (energies,
  charge, tracks, particles, ..)

• Analysis Find collisions with similar features,
  use of complex algorithms to extract
  physicsCollective iterative discovery of
  hundreds of physicists professors and their
  students

• Simulation start from theory and detector
  characteristics and compute what detector should
  have seen

6
Challenge 3 Providing a mountain of CPUs
CalibrationReconstructionSimulationAnalysis
For LHC computing,some 100 Million SPECint2000
are needed!
1 SPECint2000 0.1 SPECint95 1 CERN-unit 4
MIPS - a 3 GHz Pentium 4 has 1000 SPECint2000
7
Computing for LHC
Europe 267 institutes 4603 users Elsewhere
208 institutes 1632 users
Solution Connect scientific
computing centres into an
integrated computing grid
CERN has over 6,000 users from more than 450
institutes from around the world
-- uniting the computing resources of
particle physicists in the world!  
8
What do we mean by a Grid?
Interconnected Collaborating Computer Centres
9
?The virtual LHC Computing Centre
Grid
ATLAS Virtual Organisation
CMS Virtual Organisation
10
The LHC Computing Facility

• The user ---
• sees the image of a single cluster
• does not need to know - where the data is
• - where the
  processing capacity is
• - how
  things are interconnected
• - the
  details of the different hardware
• and is not concerned by the differing policies
  of the
  equipment owners and managers

The Grid hides the complexity -- leaving
the user to concentrate on physics
11
Goal of the LHC Computing Grid Project
The Grid is just a tool towards achieving the goal

• To prepare and deploy the computing environment
  to help the experiments analyse the data from
  the LHC detectors
• Phase 1 2002-05development of common
  applications, libraries, frameworks, prototyping
  of the environment, operation of a pilot
  computing service
• Phase 2 2006-08acquire, build and operate the
  LHC computing service

12
LHC Computing Grid Project - a Collaboration

• Building and operating the LHC Grid involves a
  collaboration of
• The physicists and computing specialists from the
  LHC experiment
• The projects in the US and Europe that have been
  developing Grid middleware
• The regional and national computing centres that
  provide resources for LHC
• and usually also for other physics
  experimentsand other sciences

Researchers
Software Engineers
Service Providers
13
The Project Organisation
Applications Area Development environment Joint
projects Data management Distributed analysis
Middleware Area Provision of a base set of
gridmiddleware acquisition,development,
integration,testing, support
CERN Fabric Area Large cluster management Data
recording Cluster technology Networking Computing
service at CERN
Grid Deployment Area Establishing and managing
theGrid Service - Middleware certification,
security, operations,registration,
authorisation,accounting
Phase 1 2002-05development of common software
prototyping and operation of a pilot computing
service Phase 2 2006-08acquire, build and
operate the LHC computing service
Enabling Grids for e-Science in Europe
14
LCG Staff at CERN by source of funding
15
LCG Phase 1 - Commitments for Special Funding for
People at CERN
16
Project Leader Tony Doyle a.doyle_at_physics.gla.ac
.uk
17
High Energy Physics Leading and Leveraging Grid
Technology
Many national, regional Grid projects
-- GridPP(UK), INFN-grid(I), NorduGrid, Dutch
Grid,

• European projects

US projects
18
LCG Service Status

• Middleware package components from
• European DataGrid (EDG)
• US (Globus, Condor, PPDG, GriPhyN) ? the Virtual
  Data Toolkit
• Agreement reached on principles for registration
  and security
• Rutherford Lab (UK) to provide the initial Grid
  Operations Centre
• FZK (Karlsruhe) to operate the Call Centre
• Service opened on 15 September 12 sites
• Now 28 sites operational
• Second software releasescheduled for next week

19
(No Transcript)
20
The Challenges of Grid Computing
Keep the expectations in line with reality!

• Middleware maturity
• Service quality standards ?? innovation
• a second (or third) generation of middleware will
  be needed before LHC starts
• Grid operation
• There is not yet any significant experience to
  build on
• Data migration
• Replication, caching, security, policies
• Collaboration
• From computer centre empires to a federation
• Consensus rather than control
• International research networking
• Security our biggest risk

21
EGEE Enabling Grids for E-science in Europe

• EU 6th Framework Project
• Create a Grid for European Science
• Supporting many application domains with one
  large-scale infrastructure
• Providing round-the-clock access to major
  computing resources, independent of geographic
  location
• Emphasis on grid deployment (rather than
  development)
• Leverages national and regional Grid programmes
• building on the results of existing projects
• National Research Networks and the EU Research
  Network Backbone Geant

22
EGEE Partners

• 70 institutions in 27 countries organised into
  regional federations
• Starts from the European subset of the LCG
  service
• Joint EGEE-LCG middleware activity

23
Grid Applications for Science

• Medical/Healthcare (imaging, diagnosis and
  treatment )
• Bioinformatics (study of the human genome and
  proteome to understand genetic diseases)
• Nanotechnology (design of new materials from the
  molecular scale)
• Engineering (design optimization, simulation,
  failure analysis and remote Instrument access and
  
• control)
• Natural Resources and the Environment
• (weather forecasting, earth observation, modeling
• and prediction of complex systems, earthquake)

24
Key LCG goals for next 12 months

• Integration in the experiments mainline software
  suites of the LCG common software tools, object
  persistency system, simulation framework
• Major Data Challenges of the four experiments
  developing/validating the data analysis models
  using the LHC Grid? establishing LCG as a
  reliable, available, high-capacity service
• Demonstrate a base solution for LHC startup
• Preparing a second generation of Grid middleware
• Hardened, re-engineered
• Forging a collaboration of EGEE with
  experiments, other sciences . and similar US
  projects

25
The LHC Computing Grid Applying computer
science and computer engineering
to fundamental physics
research The nucleus of a Grid infrastructure
for science?