R. Smareglia:

1
R. Smareglia P. Manzato L. Marseglia G. Gasparo
IA2
2
IA2
3
(No Transcript)
4
TNG_at_IA2

• The TNG general archive is available on line
  since 06/2006 http//wwwas.oats.inaf.it/IA2
• A notable work has been done, mainly addressed to
  easily make the archive complete and usable by
  the national and international communities.
• A web interface was developed to allow users to
  access to the archive in a "classical way",
  while, in parallel, a Data Access Layer was also
  developed to integrate the TNG archive within the
  Virtual Observatory (VObs).
• IA2 Funded on 2005
• TNG Archive
• LBT raw data archive infrastructure (Italian
  Time)
• Reference for VObs technologies

5
TNG_at_IA2 Data Policy
6
TNG_at_IA2

• 1999 Not still in the DB
• 2000 ? 16.438
• 2001 ? 39.011
• 2002 ? 34.568
• 2003 ? 47.461
• 2004 ? 38.915
• 2005 ? 29.260
• 2006 ? 15.254

• Data on line until 31-07-2005
• Logs on line until 22-08-2006

7
Hardware/Software Archive Structure

• Some hardware and software infrastructures has
  been re-used from the TNG/LTA Pilot Project as a
  basis for the new software interface and hardware
  tools. New hard/soft have been acquired as
  production items.
• Hardware
• 15 Tb Raid 6 storage
• 4 bi-processor Workstations used for
• Scientific DB
• Housekeeping DB
• Web interface
• Developing and testing
• DVD juke box system (Rimage 2000i)
• Software
• Oracle DB (based on the INAF Campus license)
• DBMS Enterprise edition
• Application Server
• Java Development Suite
• Zend Studio (PHP development suite)

8
Lesson Learned 1/2

• Creating a user-friendly archive is not only to
  ingest the data, create a web interface or
  implement all VObs standards (UCD, VOTable, SIAP,
  etc.), but to make these data easily accessible
  by the community. This implies to check the data
  consistency (not a quality control of the
  scientific data). Some problems were found
• Keyword consistency During the history of the
  telescope some keyword was changed due to the
  natural evolution of the instruments or, in same
  case, due to an initial wrong definition (RA
  evolved through RA-DEC, RA_DEC and due to a
  misunderstanding RA-DEG ). Unfortunately all
  these changes were not documented.
• Value consistence As in the previous case,
  values connected with some keyword (e.g. FILTER
  in a simple case or OBJECT in a more complex
  case) are not uniformly defined (FILTER can be R
  JOHN or R-JOHN or R Johnson) and not
  documented.
• WCS (World Coordinate System) The FITS header
  of the TNG images doesnt include the WCS
  keyword. RA and DEC are present, but, if you
  download the images via a VObs tool (Aladin,
  Tomcat, ) to compare data with other VObs
  archives or catalogs, a post processing of the
  images is needed. An automatic pipeline to
  include this keyword is under testing phase.

9
Lesson Learned 1/2

• Calibration pipeline This isnt exactly a
  problem but a useful option, which relates to the
  WCS pipeline and to the easy usability of the
  archive through the VObs tools. Together with the
  WCS pipeline, to have a quick-look calibration
  pipeline available for each instrument would
  make the data more usable by the community in the
  first phases of their scientific use.
• IVOA standards The IVOA standards are under
  development. Some of them (UCD, VOTable, SIAP)
  already have a first stable version. Other like
  Resource Registry, or ADQL, are in a stormy
  pre-release version. This implies a continuous
  work of the IA2 staff to upgrade the DAL (Data
  Access Layer) to maintain the archive
  VO-compliant.
• User interaction The requests on how the
  archive must be organized and how it can be used
  have converged on a usable interface and archive
  interface upgrade (e.g.. request to have an easy
  way to identify and download the calibration
  files). This interaction must be constant to
  obtain an improvement of the service.

10
TNG_at_IA2 Data Access
11
TNG_at_IA2 Data Access
12
TNG_at_IA2 Data Access
13
TNG_at_IA2 Data Access ? VO ? SIAP

• Not again science-ready

14
LBT_at_IA2

• LBC / LBT Italian time
• Raw data Archive
• Strong Collaboration with LBC Survey Science
  Archive (OA Roma)
• Hardware and Software ready for ingesting and
  distribute data to users (based on TNG_at_IA2)

15
LBT_at_IA2
16
ITVO _at_ IA2

• Numerical Simulation
• In order to analyze what is needed to handle data
  produced by numerical simulations, we have
  considered a wide spectrum of applications
• Particle based cosmological simulation
  Gadget2, Fly Codes
• Grid based cosmological simulation
  Enzo, Hydropad Codes
• Magneto-hydrodynamics simulation
• Planck simulation

We focused our work on a set of numerical
simulations of -) galaxy clusters identified at
redshift 0 and produced with the GADGET2 code -)
data from ENZO code
17
ITVO _at_ IA2

• Theoretical VO is a IVOA Interest Group
• Strong Interaction with these Working Group
• Data Model (DB Structure)
• UCD (Unified Contents Descriptions)
• SNAP (Simple Numerical Access Protocol)
• Registry
• Grid and Web Services
• ITVO is full involved in the TVO OATrieste,
  OACtatania, CINECA, OATeramo

18
ITVO _at_ IA2

• Theoretical Data
• Simulation box GADGET2 and ENZO
  output ... Raw Data
• Clusters (1989 117 clusters
  with 17 different red-shift)
  obtained by subdividing the initial box
• Maps obtained from clusters
  post processing
• Density and Temperature profile . obtained
  from clusters post processing

Starting up from Raw Simulated data, any
additional knowledge, with relevant physical
sense, are obtained through post processing
All these data (raw and post processing) cant be
stored in a single DB structure.
A multiple (evolutional) DB structure must be
implemented and the SNAP protocol must allowing
an interactive and/or on-demand retrieval of
the Theoretical data
19
ITVO _at_ IA2 DB structure
20
ITVO _at_ IA2 SNAPSimple Numerical Access Protocol
21
ITVO visualization
22
ITVO _at_ IA2

• The activity to integrate the Theoretical Data
  into the VObs environment imply a strong
  coordination with all people and projects
  involved. First of all, the main discussion
  place where a standard Data Model, UCDs and
  Access Protocol (SNAP) is defined is the IVOA
  Theoretical Interest Group. In this group, the
  authors are active to export our experiences
  developed mainly inside some project like
  VO-TECH, VO-DCA and ITVO. VO-TECH, VO-DCA are
  EU-funded projects.
• The Italian people involved in the VO-TECH and
  VO-DCA plus the CINECA had also extend that
  target inside the Italian astrophysical
  community, and mainly at that people that are
  heavy involved on the simulated data.
• The Italian Theoretical Virtual Observatory
  (ITVO) is part of the VObs.it project. NOT
  FUNDED

23
Conclusions

• Archive
• TNG is VO Compatible.. But not science ready
• LBT use TNG archive knowledge for VO and
  archive
• ITVO development
• IVOA
• All IA2 people are full involved in many IVOA
  activity
• Attended at IVOA meeting
• ITVO working group
• VO Dissemination