Data flow in LBC

1
Data flow in LBC

• SW design development
• R. Smareglia (Trieste)
• A. Fontana (Rome)
• A. Di Paola (Rome)
• F. Pasian (Trieste)
• M. Nonino (Trieste)
• A. Baruffolo (Padova)
• M. Turatto (Padova)
• R. Falomo, G. Piotto, L. Pulone,
• M. Sgorlon, F. Gasparo
• and more

2
Introduction

• Requirements
• Control / data flow
• Architecture
• GUI / OB
• DH / DMF
• Open tasks and issues

3
Requirements
4
Data flow
Image size 4 x 2048 x 4600 72 Mb Read-out
time 10 s
5
The LBC_at_LBT control software

• Interactions with TCS
• Pointing
• Small offset
• Queries about status
• Provide IA results
• Provide tracking feedback

6
The LBC_at_LBT User Interface

• SW working group defined the requirements (M.
  Turatto)

7
GUI requirements

• Priority to easiness (menu, wizard, helps on
  line)

• Stand alone application (Java) that stores OB
  on ASCIIformatted data (XML) each OB on a
  single file

• Full support to binocular mode (Master/Slave)

• Integrated with exposure time calculator

• Lists of OB editable and browsable

• Interactive module for accurate pointing/tracking

8
GUI detail design project
9
GUI detail design project
10
The LBC_at_LBT control software
11
The LBC_at_LBT control software
Data Handling System

• Backbone of data analysis
• Organize data in a DB
• Prepare Output Media
• Feedback to OB managment
• Prepare long-term archive

12
The LBC_at_LBT control software
Data Processing Unit

• Minimal user workstation
• Optimal Pipeline System

13
Data Handling System

• Based Logically on Data Handling at the TNG (AaT)
  properly scaled
• Each data handling step is database-controlled,
  thus guaranteeing integrity
• The DBMS chosen is Oracle (Object-relational)
• Data storage as compressed FITS files (FITSIO
  std)
• Interface to Archive/Data-Base and data
  processing pipeline

14
DMF architecture HW/SW

• DMF DHS DP Archive
• Parallel (multi-CPU processor) for data
  processing pipeline
• Linux OS
• Appropriate mass storage
• 0.5 - 1 Tb of On Line Data Storage
• Appropriate archive data storage (DVD media)
• Need to create 2 copies of the data
• Observer
• Instrument Archive
• Use of commercial off-the-shelf (COTS) and/or
  stable public-domain software maximized
• database management system (Oracle)
• data processing environment (IDL, IRAF, )
• libraries (FITSIO, etc.)
• Dedicated approach for pipeline best for quality
• Multi-CPU processor or beowulf system for data
  processing pipeline (DPP)
• Grid / Data Grid

15
The LBC_at_LBT control software
LBC Archive System

• LBC Archive of Italian time (25)
• Storage
• Raw data
• Calibration standard

16
LBC archive

• Need to provide the Italian community with
  scientifically-usable data from LBC
• Calibration plan
• Data quality control ( on-line / off-line )
• Trend analisys
• Data to be calibrated at a standard/optimal
  level
• System to be built using experience from the TNG
  LTA prototype

17
Open tasks and issues

• Need a careful testing of simulated data flow
• Housekeeping data storage
• LBC
• LBT
• General Archive of LBT Italian observation time
• Proprietary period
• Optimization of resources for development and
  operations
• Maintenance and use expense (media, etc )