gLite DMS

1
???????? ? ????

• ?????? ?.?.
• ????????????? ???????? ??????? ??????
• ?.???????

2
??????????? ???????? ????

• ????????????? ???????? ??????? ???????????? ?????
  ? ?????????? ???????????????? ???????? ??????.
• ???????? ????? ??????????? ?????? 9 ???????
• 1986 2000 x 340 000
• 2001 2010 x 4000

• ??????? ?? ?????? ???????????? ???????????????????
  ??? ?????????????? ???????? (????? ?????????)
• ?????????????? ???????? ??????????? ?????? 18
  ???????
• 1986 2000 x 500
• 2001 2010 x 60
• ???????? ???????????? ????????- ??????????
• ????????????? ??????? ??????? ???????, ??????????
  ? ??????-?????

3
???????

• 19851995 ????????? ????????????? ???????? ?????
  ??? National Science Foundation (NSF)
  Supercomputer Centers. ????????? ????????
  ???????? ???????????????? ?????????????? ?
  ?????????? ????????????????? ??????? ???
  ????????? ????????????? ????? ? ????????????.
• ??????? 1997 NSF ??????????? ????? ?????????
  ???????? ?????????????? ?????????? Partnerships
  for Advanced Computational Infrastructure (PACI).
  ???????? ????????? ????-??????????????, ???
  ????? ???????? ?????????????????????
  ??????????????. ??????????????, ??? Grid ?????
  ?????????????? ? ???????? ??? ????, ?????
  ????????????? ????????????? ??????????????
  ???????????? ???????.
• 1998 ?????? (? ??????? ???????????)
  ???????????????? ????? Globus Toolkit. ????????
  ??????????????? ????? ???????? ????-??????????????
  (???????? de facto)
• 1999 ?????????????? (? ??????? ?????????)
  ????????????? ???????
• ????-?????????? Global Grid Forum (GGF)
• 2002 GGF ? IBM ???? ???????????? ?????
  ????????? ?????????? Open Grid Service
  Architecture (OGSA), ????????????????? ? ????
  ??????? ? ????????? ???-????????
• 2003 ??????? ??????????? Enterprise Grid
  Alliance (EGA) ????????? ?????????????
  ?????????? ?? ????-??????????? ? ????????????
  ?????????????? (Fujitsu, Siemens, HP, Intel, NEC,
  Oracle, Sun, EMC)
• 2006 GGF ? EGA ???????? ? ??????? ? ???????????
  Open Grid Forum (OGF)

4
??? ????? ????

• ?????? ???? ??? ?????? ?? ???????? ?
  ??????????????? ?????? (electric power grid)
• ?????? ????????? ??? ????????? ????????????
  ?????????? ???????????? ? ???????? ???????????
  ???????, ?? ???????? ? ???, ?????? ??? ???????
• ??????????? ????????
• World Wide Web ???????????? ?????? ? ??????????,
  ??????? ????????? ? ????????? ????????? ????????,
  ????????????? ?????????????? ?? ????? ????
• ? ??????? ?? WWW ???? ??? ????? ??????????????
  ??????????????, ??????? ????????????
  ????????????? ?????? ? ?????????????? ????????? ?
  ???????? ???????? ??????, ?????????????? ?? ?????
  ????

5
???? ? ?????????????? ??????????

• ?????????????? ?????????????? ??????????????
  ???????????? ? ?? ????, ?? .
• ?????? ??? ???????????? ????? ????????? ???
  ?????????????????? ???????
• ????????? ??? ????? ???????????? ???? ??? ???
  ????????? ?????? ?????????????
• ?????? ?????????? ????????????? ??????????
• ?? ??????????? ?????????? ????????????? ????????
  ?????? ???????????
• ???? ???? ?????? ? ????????????
• ????????? ???? ????????
• ?? ?????? ?????????? ?????????? ?????, ??????,
  ?????????? ? ???????? ?????????????????
• ????????? ??????? ??????????????
• ????????? ?????? ?????????? ?????
  ????????????????? ? ???? ?????????? ?????????
• ?????? ? ???????? ????? ??????? ????????????????
  ??????? ??? ??????????????? ?????????? ??
  ????????? ?????????????
• ???????????? ??????? ????????
• ??????? ????? ???????????/?????????/??????????
• ???????????????? ?? ????????? ????????

6
??? ????? ????

• ???? ??? ????????? ???????????
  (???????????????, ????????, ????????????
  ??????????, ), ??????? ???????? ??????,
  ??????????? ?????????, ?????, ??????? ?????
  ??????????? ??????? ? ???????? ????-???????.
• ??? ??????????? ?? ???? ????????
• ??? ????? ???? ????????????? ???????????? ?
  ????????? ??????????? ?????? ???????? ??????
• ??? ????? ???? ???????? ?? ??????? ??? ??????????
  ????????? ?????????????

7
???????????

• (Ian Forster What is Grid, 2002 ?.)
• ???? ??? ???????, ???????
• ???????????? ????????????? ???????? ???
  ??????????
• ????????????????? ?????????? ?????
  ?????????
• ?????????? ???????????, ????????, ?????????????
  
• ????????? ? ??????????
• ???????????? ?????????????????? ????????????

8
????????? ??????????? ????

• ? ??????? Web ?? ????? ????? ?? ?????????
  ?????????? ? ?????????, ? ? ??????? Grid ?? ?????
  ????? ?????? ? ?????? ??????? ??????????????
  ????????, ????????? ??????, ???????????
  ??????????? ? ?.?. .
• ????-?????????? ??? ?????????????????
  ?????????? ???????? ? ??????? ????? ? ???????????
  ?????????? ??????????? ???????????? ?? ???????
  ???????????
• ??????????? ??????????? ???????????
  (????????????) ???????????? ?? ?????????
  ?????????? ???????,??????? ???????????? ???
  ?????????? ????? ????

9
??????????? ???????????
??????????? ???????????? ??????????? ????????,
??????? ????????????? ??????????????????? ? ??
???????????
????? ??? ??? ??????, ? ???? ?? ????? ?????????
?????? ??? ?????
???????????? ?????? ? ????????? ????????
????????????? ?????????????? ??????? ?????? ???
????? ??????????
????? ?????????????? ??????????? ? ?????
???????????? ????? ?????????????
?????? ???????? ????????????? ??????????????
?????????????
10
??? ???? (middleware)

• ?????????? ?????????????? ????? ?????????????
  ????????? (????????????? ?????????, ?????????????
  ?????????????? ????????????), ???????????? ?
  ?????????????? ???????? ?????? ??? ??????
• ????????????? ??????????????????? ????????????
  ???????????, ???????????middleware

• Middleware ???????? ??????????? ??????
  ????-?????????????? ? ???????????? ??????????
  ??????????/????????????? ????????
• ????????-????????? ?? ???????????? ??????????
  ???????? ??????? ? ??????????? ????????

11
??? ???? (middleware)

• ????????? ?? ??? workstation

• ????????? ????

• ??? ????? ?????? ???????? ??????????
  (??????????????)
• ????????????? ????, ?????????????? ???
  (???????????)
• ?????? ???????
• ?????????? ??????? ????????, ??????/??????,
  ?????? ??????????

• ??? ????? ??? (account) ? ??????
  (??????????????)
• ????????????? ????, ??????????? ???
  (???????????)
• ?????? ???????
• ?????????? ??????? ????????, ??????/??????,
  ?????? ??????????

• ?????????? ??????? ??????????? ?? ????

• ??????? ??????????? ????? ????????

• ???????????? ???????

• ??? (middleware)

• ???? ???????????????? ?????

• ????????? ???????????????? ???????

12
EGEE middleware
gLite 3.1(2007)
13
???????? ??????????
User Interface (UI) ??? ???????????? - ?????
????? ? ????
Resource Broker (RB) (Workload Management System
(WMS))?????????? ???????????? ?????
???????????? ??????? ? ?????????? ????-?????????
Information System ???????? ?????????????? ?
?????? ????????
File and replica catalog ?????????????? ?????? ?
???? ? ?? ??????
Logging and Bookkeeping (LB) ?????? ???????,
????????????? ? ????
Computing Element (CE) ??????? ??????? ??
?????????????? ????, ??? ????? ???????????
??????? ????????????
Storage Element (SE) ?????? ???????? ??????, ???
??????????? ???? ????? (??????/??????/???????????
) ??? ?? ???????
14
???? ????-??????
???? ????-?????? ? ??????? ???????? ?????

• ?????????????? ???? ??? ???????????? ????????
  ?????????? ?? ???? ????????????? ????? ?????
  ?????????? ???????? (Computational Grid)
• ?????????????????????? ?????????? (HPC)
• ?????????? ??????? ?????????? ???????,
  ???????????? ???????????? ??????????
• ?????????? ????????? ???????????? ??????????
• ????????????????? ?????????? (HTC)
• ?????????? ??? ????? ???????? ?????????? ??????
  ??????? ?? ???????????? ??????
• ?????????? ????????????? ????????? ???
  ????????? ??? ????????
• ???? ??? ??????????? ????????? ???????? ????????
  ?????? (Data Grid)
• ??? ???????, ? ?????????????? ?????????
  ?????????????? ??? ??????
• ????????????? ???? ??? ???????????? ??????? ??
  ????????? ??? ?????? (Semantic Grid)
• ?????????? ????????????? ?? ????????? ????????
  ?????? ??? ??????? ??????? ?????

15
??? ??????? ??????? ? ????

• ????? ???????? D
• ???????????? ???????? U
• ???????????? ????? ????? ????????? ????
• U D gt ??????? ?????? ????
• U gtgt D gt ???????????????? ?????? ????
• U ltlt D gt ?????????? ?????? ????

16
??????? ?????? ????
Inst1
Inst4
????????
Inst2
Inst3
17
?????????????? ??????? ??????

• ?????? ????? ????????????? ???????
• ???????????? ???????, ??????? ??????????? ?????
  ?????????????? ? ?????????
• ?????? (????????????? ? ??????????-??????????)
  ????? ???????????? ??????????????? ??????? ???
  ??????? ????? ??????????? ???????
• ???????????? ???????????? ????? ???????? ?
  ?????????????
• U D
• ???????
• GT-2 (Globus Toolkit- 2) grids
• JGrid (?????? ?????????? ???? ?? ??????
  ?????????? Jini, ??????? )
• ????????
• ????????? ? ???????????? ?????????? ? ?????????
  ?????? ???????? ??????? ???????
• ??????? ???????? ? ??????????? ? ?????????????

18
???????????????? ????
Company/univ. server
Donor Company/Univ. or private PC
Application
????????
Donor Company/univ. or private PC
Donor Company/univ. or private PC
19
?????????????? ?????????? ??????

• ?????? ????? ????????????? ???????
• ???????????? ???????, ??????? ??????????? ?????
  ?????????????? ? ?????????
• ?????? ???? ??? ???????????? ????????? ????????
  ????? ???????????? ??????? -gt ?????????
• ?? ???????? ???????????? ?????? ?????????? ?????,
  ????????????? ????????? ?????????? ?? ??????? -gt
  ?????????
• ????????????? ???????????? ????? ???????? ?
  ?????????????
• U ltlt D
• ???????
• BOINC (SETI_at_home ), GIMPS, Distributed.net
• ????????????
• ?????????????? ??????? (??) ???????? ?????????
  ???????
• ????????? ? ???????????? ????????? ????? ???????
  ????? ???????, ??? ? ?????? ????????????????? ????

20
?????? SETI_at_home

• ????????? ??????, ?????????? ???????????????
  ???????
• ????? 5 ???. ??????????
• 1200 CPU ??? ? ????
• ?????????? ?????????????? ???????? 34 TF
  (???????? ?????, ????? ?????????? ? ??????????
  ????? ? ??????)
• ??????? ??????? ?????????????? ???????? - gt77
  ????????? ????? ???????????

21
?????-????
?????? ?????-????, ?????????? ?? ????????
????-????? ?? ?????? ????????????? ??????????????
???????? ??????? ???????????, ????????????? ?
???????????? ??????? ??????? ???? ?????? ?
???????????? ?????.
22
???????????????? ?????? ????
Inst1
Inst2
Donor and user
Donor and user
????????
User N
User 1
23
?????????????? ???????????????? ??????

• ??????? ????? ???? ?????? ????????????????
  ????????? ????????, ??????? ????? ??????????
  ???????? ???????????? (7/24)
• ?????? - ?????????? ???????
• ?????? ????? ???????????? ??????????????? ???????
  ??? ??????? ????? ??????????? ???????
• ????????????? ???????????? ????? ???????? ?
  ?????????????
• U gtgt D
• ???????
• WL?G (World LHC Computing Grid)
• EGEE (Enable Grid for E-sciencE)
• NorduGrid (??????)
• TeraGrid (???)

24
???????? ???? ? ?????? ??????? EGEE

• ?????????? ???????? ??????????????????????
  ????????????? GRID ??????????????, ?? ????????? ?
  ????????
• ????????????? ?????????????? ?????? ?
  ?????????????? ???????? ?????????? ?? ??
  ??????????????? ?????????
• ?????????? ????????????, ???????????? ?
  ???????????? ????-?????????? ? ?????? ???????
  ????-?????????????? ??? ????????? ???????
  ????????????
• ?????????? ????????????? ?? ????????? ????
  ???????????? (????????, ?????????, ????????, ) ?
  ?????????? ?? ??????? ??????? ???????? ?
  ?????????

25
????????? ????? ???????
?????? 2004 ?????? ?????????
26
EGEE-II ????????? ? ????????

• ????? 90 ?????????
• 36 ?????
• 12 ?????????
• à ??????? ????????????? ? ???????????? ????
  ??????? ? ??????, ???, ????
• ????? 80 ????????????? ?????-?????????,
  ??????????? ? ??????????? ? ?????? ????????
• BalticGrid, SEE-GRID, EUMedGrid, EUChinaGrid,
  EUIndiaGrid, EELA, Naregi, OSG, TeraGrid

27
??????? EGEE-II ??????

• 237 ??????? ? 45 ???????
• 36 000 CPU
• 5 PB ???????? ??????, tape MSS
• ?????????????? ??????????
• gt200 ?? ?? ????????? ???????? ?????

28
?????????? ????? EGEE
29
?????????? ????? EGEE
30
?????????? ???? EGEE

• ???????????? ????? ?????????? (OM?)
• ???? - ????? ???????????
• ?????? ??????? ?????????????? (CIC) - 5 ???????
  (??????????????, ???????, ????, ??????, ??????)
• ??????????? ?????????? (24x7) ?????? ???????
  ????-?????, ?????????? ???????
• ?????????? ? ???????? ?? ??????????? ??????,
  ???????????? OMS
• ??????????? ????????? ????? 2-?? ??????
• ???????????? ???????????? ?????? (ROC) 11
  ???????
• ????????? ????????????? ? ???????????????
  ????????
• ??????????? ???????????? ????????

31
????????? ??????
RC Resource Centre
32
? ????? (CERN)

• ?????????? ?? ??????? ?????????-???????.
  ?????????? ? ???? ????????????????? ????? ?? ???
• ???????? ????????????? 500 ????????????? ?
  ?????????? (????2500???., 6500 ????????? ?? 40
  ?????)
• ??????? ????? ???????? ? ??????????? ????? ?????
  ??????????, ??????? WWW.
• ??????????? ??????????? ????????? ?? ??????
  ????????? ??? ??? ??? ????? ??????? ? ????.

33
??????? ???????? ????????? (LHC)

• ????? ?????????? ?????????? 27 ??.
• ?????? ? 2008 ????

34
???????????? ?? ???
35
????? ??? ????????? ATLAS
36
???????? ATLAS
37
?????? ???
1 ???????? (1MB) ???????? ?????????? 1 ????????
(1GB) 1000MB DVD ????? 1 ???????? (1TB)
1000GB ????? ???? ????, ???????? ?? ??? ? ???? 1
???????? (1PB) 1000TB ?????????? ?? ??? ????
??????????? ??? 1 ???????? (1EB) 1000 PB ?????
??????????, ??????? ?????????? ?? ??? ???
????????????

• 40 000 000 ???????????? ? ???????
• ????? ??????????, ???????? ?????? 100 ??????? ?
  ???????
• ????? ???????????? ?????? ??? ?????? ???????
  1??
• ?? ??? ?????????? ???????? 1010 ??????? 10
  ???????? ?????? ? ???

CMS
LHCb
ATLAS
ALICE
38
????????????? ???? ??? ???

• ????? ?????????? ?????? ??? ????????????? 20
  ????????? ?????????? CD ?????? ? ???. ??? ??
  ????????
• ?????? ?????? LHC ????????? ??????????????
  ?????????, ????????????? ???????? 100000 ?????
  ??????????? ???????????. ??? ?? ??????
• ??????? ???? ??? ?????? ?????????? ????? 1000 2-?
  ???????????? ?? ? 8 ?? ?????? ?? ?????? ? ??
  ??????. ?? ????? ????!!!

????? ??????????? ?????????????? ????????
??????? ????? ????
39
???? ????? ? ??????? EGEE

• ???????????? ?? LHC ???????????? ???????????????
  ????????????? ??????????? ??? ???????? ?
  ????????? ??????.
• LHC Computing GRID (LCG ??????) ? GRID ??????????
  ???????? ???????????????? CERN. ??? LCG-2 ????
  ??????? ??? ????????? ?????? ??? EGEE (EGEE-0).

?? ???? ????????? CERN ???????? ????????
????????? ? EGEE ???????.
40
?????????? ? EGEE

• ??? ????????????? ?? ?????????? LHC (ATLAS, CMS,
  ALICE, LHCb) - LCG
• ??????????? ? ??????????????
• GATE - ??????????? ?????????? ? ????????????
  ???????? ????????????
• gPTM3D - ????-??????????????? ?????? ?????,
  ????????? ? ??????? ?????????? ???????????????
  ??????????? ???????????? ???????,
• Mammogrid - ??????, ??????????? ????????
  ?????????????? ???? ?????? ??????????
• GPS_at_ ?????? ?? ??????????????, ???????????
  ????????? ????????? ??? ??????? ??????
• CDSS - ??????????? ??????? ????????? ????????
  ???????
• ????????????? ?????????????? ?????????????
  ???????? ? ???????-???????? (?????? WISDOM )

41
?????? WISDOM

• ?????????? Drug Discovery, ??????????? ?????????
  ??????????? ??????? ???????? ????? ?????????????
  ?????????? ? ??????-???????
• ?????? ? ??????? ??????????? ????? ????????
  ????????? ?????? (???????)
• ??????????? 46 ????????? ?????????? ??????
• ???????? ????? 1 ?? ??????
• ???????????? 1000 ??????????? ?? 15 ?????, ???
  ?????????? 80 ??????/???
• ??????? ?????? ????????? 600
• ?????? ????? (?????? ?????)
• ???????????? 5000 ??????????? ?? 27 ?????, ???
  ?????????? 420 ??????/???
• ???????? ????? 2 ?? ??????
• ??????? ?????? ????????? 2000

42
?????? ??????????

• ????? ? ?????
• ?????????? ?? ???????????? ????? ?? ?????????,
• ?????????? ????????????? ??????? ???? ?
  ?????????? ?????????? ????,
• ???????????? ??????????????? ??????????,
• ?????? ????? - ????????? ?????????????
  ?????????????.
• ????????? (???????????? ?????????? Geocluster)
• ??????????? (??????? MAGIC, Planck, ANTARES,
  NEMO)
• ???????????? ?????? (?????? ITER)
• ?????????????? ????? (??????? CHARON, CompChem)
• ??????????
• ?????????? ?????????? (?????? EGRID)
• (????? ????? 200 ??????????? ???????????)

43
???????, ????????? ? EGEE
???????,?????????????? ?? ??????????? EGEE07
44
???????????? ???? ??????????

• ??????  UK National Grid Service
  http//www.ngs.ac.uk
• ???????  Austrian Grid Initiative
  http//www.austriangrid.at
• ???????   BEgrid  http//www.begrid.be/
• ????????  Bulgarian Grid Consortium, BGGC,
  http//www.grid.bas.bg/consortium.htm
• ????????  CRO-GRID http//www.srce.hr/crogrid/
• ?????  METACentrum http//meta.cesnet.cz
• ??????? Estonian Grid, working under Estonian
  Educational and Research Network (EENet)
  http//grid.eenet.ee
• ?????????  CSC Scientific Computing Ltd.,
  http// www.csc.fi
• ???????  EGEE-FranceGermanyD-Grid,
  https//www.d-grid.de/index.php?id1L1
• ??????   HellasGrid, HG, http//
  www.hellasgrid.gr
• ????????  Grid-Ireland http//www.grid.ie/
• ???????  Israel Academic Grid  (IAG)
  http//iag.iucc.ac.il
• ?????? Italian Grid Infrastructure, IGI,
  http//www.italiangrid.org
• ?????   Lithuanian Grid LitGrid
  http//www.litgrid.lt
• ?????????  Netherlands National Science Grid,
  internally known as BIGGRID project
• ????????  Norwegian Grid (NorGrid), http//
  www.norgrid.no
• ??????  PL-Grid,  http//plgrid.cyfronet.pl   
  (public part in preparation)
• ?????????? Iniciativa Nacional Grid INGRID
  http//www.gridcomputing.pt/
• ???????  RoGrid URL http// www.rogrid.ro   (old
  version)

45
??????? ?????? ? ??????? EGEE
? ????? ??????????? ???????????????? ???????
?????? ? ???? ??????? ??? ????????? ??????????
???? (?????????? ???? ??? ??????????? ???????? ?
??????? Russian Data Intensive GRID, RDIG) ???
???????????? ?????????? ????? ?? ??????? ?
???????? ? ?????? ?????????????? EGEE, ?
??????????? ?? ????????? ?????? ??????? ??????
??????????? ?? ????????? ???????? ?????,
??????????? ? ??????????????. ?????????? ????,
???????? ???????? ? ??????? EGEE ?????????,
?????? ? ?????? ? ???????? ???????????? ?????????
?????? (Russia).
?????? ? ???? (http//www.egee-rdig.ru) ?????? 15
?????????? (? 2004 ???? - 8)
46
????????????? ?????/??????
47
???? ( ???-?? ???????/????)
48
??????????? ???? ?????????? (EGI)

• ????????????? ?????????? ??????????, ????? ????
  ??????????????
• ????????? ?????????????? ???????????
  e-??????????????, ?????????? ?? ???????????
  ????????????? (1-2 ????) ????????
• ??????????? ?????????? ? ?????????????? ?????
  ????????????? ???? ???????????????? (NGI)
• ?????????? ??????????? ??????? ????????????????
  ???? ?????????????? ??? ???????? ????? ???????
  ????????? ????????? ? NGIs.

49
??? ????? ????????????? ???? EGEE

• ?????????? ????? account ?? UI ??????????
  ????????
• ?????????? ? ?????????????? ????????
• ???????? ???????? ??????????. ??? RDIG ?????
  ???????????? (Certification Authority, CA) -
  http//ca.grid.kiae.ru/RDIG/)
• ??????????? ??????? ? ?????, ????????????? ??
  ??????????? ? ????? ????????? Registration
  Authority
• ???????? ? ??????????? ???????????
• ??????????? ??????????? LCG
• http//lcg-registrar.cern.ch/virtual_organization
  .html
• ??????????? ??????????? RDIG
• http//grid.sinp.msu.ru/grid/roc/voinrdig

50
???????? ??????

• http//www.eu-egee.org - ?????? EGEE-II
• http//egee.lib.ed.ac.uk/ - ???????????
  ?????????? (EGEE Digital Library)
• http//www.egee-rdig.ru/ - RDIG ??????????
• http//rocmon.jinr.ru8080/accounting/ -
  ?????????? RDIG
• http//www.gridclub.ru/ - GRIDCLUB.RU
  ????????-?????? ?? ????-???????????
• http//egee.sinp.msu.ru - ????? ???
• http//egee.pnpi.nw.ru/ - ???? ???

51
????? ?????????? ???????? ? ????!
??????? ?? ????????