NVO (IVOA) ????????~14,000

1
?????????

• ???
• ?????
• 2011.11.10??

2
??

• ???
• ??
• ??
• ??
• ??
• ??

3
????

• NVO (IVOA) ????????14,000
• ????????????NASA??????
• ??????????????????,?
• MACHO ????????? 1 TB
• DPOSS 3 TB
• 2MASS 10 TB
• GALEX 30 TB
• SDSS 40 TB
• ?????????,?
• PanSTARRS?? 10 TB,????40 PB
• LSST (Large Synoptic Survey Telescope)
• 2018????, with 3-Gigapixel camera
• ?30?10 GB
• ?? 30 TB,????
• ?????????100 PB ??????!!!
• ?????????30 PB
• ?????? ????10,000-100,000?, ????
• ???????? ???????

4
??? ???????
5
???????????

• ???????
• ???
• ????
• ???
• ???
• ????????!

6
???????????

• ????
• ????
• ???
• ???
• ???
• ????? ... ??????!
• ??,????????????????

7
?????????????

• The data are mine, and
• you cant have them!
• ?????? ...
• ????????????? ...
• (????. ?,??)
• ??????????? ...
• (?????. ?,??)
• ???????????????? ...
• (?????. ?, ????)

8
??????????
Ofer Lahav, 2006, astro-ph/0610703 Summary on the
4th meeting on Statistical Challenge in Modern
Astronomy held at Penn State University in June
2006

• ?? (?. ?????)
• ?? (?. ??,??,??????)
• ?? (?. ?????????, ????????????)
• ???? (?. ??????????????)
• ???? (?. ??????, ??????, ???????????, ????? )
• ???? (?. ????????????)

9
????????

• ?? 100?1000??????????? / ??? / ???.
• ?? ?????????????????,??????.
• ?? ???????????,????????????????????.
• ?? ?????????????
• ??????? !

10
?????????

• ????????????????
• ????????????
• ?????(Astroinformatics )!
• ?????????? ????
• ??????

???? ??????????
Scientific Knowledge !

• ???????
• ??????????????
• ????????

11
??
???????????????????
??????????????,
???????????????
??????????????? ?????

12

???????
??
??
DSS
??
MIS
EDP
????
??
EDP ?????? MIS ?????? DSS ??????
13
???????????
??
????

• ????????(KDD)?????

????
???????
??
????
????
????
???
14
????????????
?????
???
????
???? ????
???
????
????
15
KDD ?????
?????
KDD
?????????
????????
???? (?????????, OLAP, ????, Web, etc.)
16
?????????

• ??????
• ?????
• ???
• ????
• ????
• ????
• ???

17
???????

• ????
• ????
• ????
• ????
• ??????
• ??????
• ??????
• ????
• ?????????
• ??????
• ??

18
????

• ??
• ??????,?????????????????
• ????????????????????????
• ??
• ??????????,??????????,??
• ????????,??
• ??
• ????
• ???
• Naïve Bayesian Networks
• ?????
• ??????
• ????
• .

19
????????
???? ???, OC1 ???? ????? ?????
???????????????,??????????? ????????????????.
???? ??, ??, ???, ????, ????, X??, ???, ??, ...
?? ?? ?? vs. ???? ?? A0 vs. B0, AGN vs. QSO
vs. ??
???? WGACAT, ROSAT All Sky Survey, ...
20
????

• ??
• ????????????????
• ??????????,??????????????,??????????,????????????
• ??
• SDSS?????????? ????,??????????
• ??
• K????
• Hierarchical clustering
• ??????(Expectation Maximization algorithm)
• ??????(Gaussian mixture modeling)
• ?????
• ???
• ????(Concept discovery)
• ????(Bootstrapping knowledge)

21
????
1
Djorgovski,etal.
22
??????? 1

• ????
• ????????????
• ??????????????????????
• ???????????????
• N gt1010, ???????????
• ?? 1000 ??, ?????????
• ???????????????
• N gt1010, N-point ??????
• ?N2logN???????????

23
??????? 2

• ???? (?????)
• ???????????????? (???????)
• ????????????????
• ??,???????
• ???? Nobel prize?
• ???? ???????????
• ?????? ??????????
• ?1000????????????(????)?,????????????
• ????????

24
??????? 3

• ????
• ????????????

• ??????
• ?? !
• ??????????????????
• ???????????????????????

25
??????? 4

• ???????
• ????????????????????
• ??1010 ???1000??????????
• ??????????????????
• ???????????

26
??????? 5

• ?????
• ????????????????????????(???????????)

27
?????????????
??
??????????? ?????????? -- ??? -- Gamma-ray
bursts -- ?????? -- X?????? -- ???? . . .
Just Checking
28
????????

• ?????????????????,
• ?????? (?,???, ??, ??, ????, ??, ???????, ???,
  ??, ???,????, )
• ??????????????????????
• ????????????????,??
• ????????????????

29
???????

• ????????????
• ???????
• ???????
• ???????????????
• ???????, ????????????,
• ??????????????

30
??????

• ??????
• ??????
• ?????
• ??????
• ????????
• ????????????,
• ???????????

31
?????????

• ????????????peta-? exa-???????
• ?????????????????????
• ????PB???????????????????????????
• PB?????????? (??????, ?????????????, ???????,
  ????????, ??)
• ??PB?????????????(????????)
• PB??????????????

32
?????????(I)

• http//dame.dsf.unina.it/

? ?????? ? ?????? ?????????? ? ??????
33
?????????(II)

• http//astrostatistics.psu.edu/vostat/

VOSTAT Statistical Analysis for the Virtual
Observatory
VOStat????????????????????????????????????????????
????????????????????????????R ????????????VOStat
???????,?????????
34
???????

• ADASS(The Astronomical Data Analysis Software and
  Systems)
• ADA(The Astronomical Data Analysis)
• Summer School in Statistics for Astronomers
• Statistical Challenges in Modern Astronomy
• Astroinformatics
• Astrostatistics

35
?????????(I)

• From Data Mining To Knowledge Discovery An
  Overview.
• Fayyad, U.M., Piatetsky-Shapiro, G., and
  Smyth, P.
• In Advances In Knowledge Discovery And Data
  Mining , eds. U.M. Fayyad, G. Piatetsky-Shapiro,
  P. Smyth, and R. Uthurusamy, AAAI Press/The MIT
  Press, Menlo Park, CA., 1996, pp. 1-34.
• Data Mining and Machine Learning in Astronomy,
• Ball, Nicholas M. Brunner, Robert J.
• International Journal of Modern Physics D,
  Volume 19, Issue 07, pp. 1049-1106 (2010).
• Scientific Data Mining in AstronomyBorne, K
  irkeprint arXiv0911.0505
• Data Mining and Discovery of Astronomical
  KnowledgeAl-Naymat, GhaziScientific Data
  Mining and Knowledge Discovery, , Volume . ISBN
  978-3-642-02789-5. Springer-Verlag Berlin
  Heidelberg, 2009, p. 319

36
?????????(II)

• ??????????????
• ??? ???.
•   ??????????, 2011,V2(3) 13-27
• Mining knowledge in astrophysical massive data
  setsBrescia, Massimo Longo, Giuseppe
  Pasian, Fabio
• Nuclear Instruments and Methods in Physics
  Research Section A, Volume 623, Issue 2, p.
  845-849.
• DAME A Web Oriented Infrastructure for
  Scientific Data Mining ExplorationBrescia, Mas
  simo Longo, Giuseppe Djorgovski, George S.
  Cavuoti, Stefano D'Abrusco, Raffaele
  Donalek, Ciro Di Guido, Alessandro
  Fiore, Michelangelo Garofalo, Mauro
  Laurino, Omar Mahabal, Ashish Manna, Francesco
  Nocella, Alfonso d'Angelo, Giovanni
  Paolillo, Maurizioeprint arXiv1010.4843
• Data Mining and Machine-Learning in Time-Domain
  Discovery ClassificationBloom, Joshua S.
  Richards, Joseph W. eprint arXiv1104.3142

37
Thank you very much !!!