Title: OAS Contribution
1- OAS Contribution
- The ACDS
- The new XCATDB based on Saada
Laurent MICHEL Christian MOTCH François Xavier
PINEAU
Observatoire Astronomique de Strasbourg
(Fr) Saada http//astro.u-strasbg.fr/websaada XCA
TDB http//amwdb.u-starsbg.fr/jacds
2The ACDS
- Delivered Products
- FITS catalogue extractions
- X-ray source counterparts
- Archival sources in the XMM field of view
- Graphical products (PDF)
- Finding charts
- Rosat Images
- Catalogue plots
- HTML product
- Browsing pages for ACDS data with many links to
CDS resources
3The ACDS
Simbad (Strasbourg France)
NED (Caltech USA)
Vizier at CDS (Strasbourg France)
Vizier at CADC (Victoria Canada)
- ACDS
- 2 Sparcs 400 Mhz
- 1Gb RAM
- 8 Agents in //
Pipeline (Leicester)
Vizier at Cambridge (UK)
Vizier at CFA (Harvard USA)
- Correlation computing
- A lot of remote server accesses
- A few computation
- File product generation
- Some remote server accesses (Aladin)
- A lot of computation
Aladin (Strasbourg France)
4The ACDS
- Actual Throughput (8 process in //)
- 3300 sec /dataset
- (8360024)/3300 209 datasets/day
- Most part of the time is pure CPU (graphical prd)
- IDL, Distiller.
- Easy to improve
- new hardware
5The ACDS
- Operation issues
- Support the pipeline throughput (but not more)
- gt 2200 datasets processed since October 13th
- 157 pending this morning due to a 2 days Aladin
shutdown - No need to improve the hardware
- CDS database upgrades
- Vizier is being moved on PSQL without serious
consequences for us - Major Simbad to be release late 2006
- New error definition (no effect for standard
users) - External failures
- Remote server shutdown
- Corrupted products returned (cache
miss-synchronization after crash) - Internal failures
- Empty Rosat images/wrong PPS index
- Hardware failure
- Spare available/never used
- Miss-configuration
- Holidays
6The ACDS
7The ACDS
8The XCATDB
- The XCATDB is not a data repository but a tool to
make science - N to M persistent relationship
- Difficult to implement in an efficient way for
complex queries - Possibility of doing more than with dynamic
cross-matches - Data-mining feature
9Saada in a few Words
- Saada An Astronomical Database generator
- Making automatic the process of building a
database - Hosting heterogeneous datasets
- Highlighting scientific content
- Publishing personal data into the VO
- Databases are installed on local machines
- Any Linux/Windows/Mac box
- Tomcat 5.xx
- PostrgreSQL 8.xx
10The XCATDB
- Based on Saada
- Queries expressed in SaadaQL
- Data loader
- How to build quickly millions of correlation
links - How to restore archival source uniqueness
- GUI
- Layout inspired from the 1XMM XCatDB
- Architecture based on native Saada GUI
- Prototype based on RC2 data open for the
community - http//amwdb.u-strasbg.fr/jacds
112nd Release of the XMM Catalogue
Native Saada Data-loader
150,000 X-ray sources In 2800 observations
Implemented with Saada relationships
Specific Module
1,000,000 links
Native Saada Data-loader
1,400,000 archival sources
Demo
12A simplified example Looking for High Mass
X-ray Binaries
HR3 (F2-4.5keV F1-2keV) / (F2-4.5keV
F1-2keV) HR4 (F4.5-12keV F2-4.5keV) /
(F4.5-12keV F2-4.5keV)
kT 5 50keV
lt 1.5keV
Demo
Hardness ratio limit for stars
13(No Transcript)
14Using UCDs in queries
- Selecting X-Rays sources by correlation patterns
on 200 classes of X-Ray sources requires to
handle a lot of meta-data
select oidsaada from Arch_9037AEntry where (
_Flux gt 1e-13 ) select oidsaada from
Arch_7181AEntry where ( _Flux2 gt 1e-16 ) select
oidsaada from Arch_9032AEntry where ( _FX gt 1e-16
) select oidsaada from Arch_9015AEntry where (
_fX gt 1e-16 ) select oidsaada from
Arch_9031AEntry where ( _Fx gt 1e-13 ) .
- Solution Expressing queries using UCDs and Units
Demo
15UCD Issue
UCDgtx1 and UCDltx2
Usually makes no sense
Solution Using unambiguous operators
UCDIn(x1,x2)
16UCD Issue (continued)
- Query language issue using a simple syntax
- One operator for one UCD
- Query execution
- Editable execution plan
- UCD attribution a sensible issue
- Using multi-words UCDs as often as possible
- Limit the columns accessible per UCDs
- Take care with units
- Existence
- Name known by the converter
- Result presentation another sensible issue
- The client must understand how resources have
been selected and accessed
17XCATDB Status and Prospects
- Data loader
- Correlation setup works fine
- Other products can be loaded with the native
data-loader - GUI
- HTML form improvements
- Display of constrained values
- Interoperability
- External Xmatch in SaadaQL (F.X. Pineau)
- Connection with ESAC resources (XSA, VOSpec)
- Connections with CDS clients (VO portals)
- VO protocols
18Thank You for your Attention