CEOS ICF

1
CEOS ICF
Baseband Data Archive InterChange Format
Stéphane MBAYEGAEL ConsultantStephane.Mbaye_at_gael
.fr
Commitee on Earth Observation Satellites
(CEOS) Working Group on Information Systems and
Services (WGISS) Meeting Frascati, Italy
2
Rationale

• Document status
• CEOS ICF - Changes
• Presentation - Data Request Broker (DRB)
• Demo Derby application

3
Document status

• 21/04/2000 Draft 0 - Creation of the document
• 29/08/2000 Draft 1 - Use of XML Schema instead
  of DTD
• 09/01/2001 Draft 2 - Includes outputs of
  Bangkok ATT meeting
• 09/04/2001 Draft 3 Presented at Sioux Falls
  (USA)
• 23/07/2001 Draft 4 Includes outputs of Sioux
  Falls ATT meeting
• 23/08/2001 Draft 5 Vega France - Technical
  proof reading
• 06/04/2002 Draft 6 ESA-ESRIN - Technical
  proof reading
• 19/04/2002 GAEL-CEOS-ICF-060.2 Issue 1,
  Revision 0

4
Partitioning Analysis
Allows partitioning

• For archives biggest than2 Gigabytes
• Continuous subsets of a single Baseband
  Interchange Unit
• Free cutting policy

Doc. 3.1
5
Partitioning Declaration

• New markup ltsubsetgt
• Moved attribute src
• Updated Naming convention

ltsignal_datagt ltsubset source"ERS-1-1999-03-12T
093812.354666-1.dat"/gt ltsubset
source"ERS-1-1999-03-12T093812.354666-2.dat"/gt
ltstartgt1999-03-12T093712.354666lt/startgt
ltstopgt 1999-03-12T094652.223553lt/stopgt
ltblock typecompositegt
lt/blockgt lt/signal_datagt
Examples ERS-1-19980225103347732-1998022510234587
6-1.dat ERS-1-19980225103347732-19980225102345876-
2.dat
6
CEOS ICF Namespace

• New XML Namespace
• http//wgiss.ceos.org/ceos-icf-20020423
• Proposed XML Schema location
• http//wgiss.ceos.org/ceos-icf-20020423.xsd
  (TBC)
• Use of xsdtargetNamespace in the CEOS ICF Schema
• Recommend the use of xsischemaLocation

ltceos_icf xmlnshttp//wgiss.ceos.org/ceos-icf-2
0020423 xmlnsxsihttp//www.w3.org/2001/XMLSc
hema-instance xsischemaLocationhttp//wgiss.
ceos.org/ceos-icf-20020423 http//wgiss.ceos.or
g/ceos-icf-20020423.xsdgt lt/ceos_icfgt
Doc. 4.1
7
Blocks
8
Block interface
9
Composite block
ltblock nameSignal Data Record
typecompositegt ltoccurrencegt117235lt/occurrencegt
  ltblock typetelemetry_mapgt ltlengthgt6120lt/
lengthgt ltdownlink_lengthgt6120lt/downlink_offsetgt
lt/blockgt lt/blockgt
10
Telemetry map
11
Telemetry map - example
ltblock nameChannel 1 status typetelemetry_map
gt   lt-- Definition within the CEOS
ICF Signal Data File --gt  
ltoffsetgt2lt/offsetgt ltlengthgt2lt/lengthgt
  lt-- Corresponding subset within the
telemetry --gt   ltdownlink_offset
unitbitgt200lt/downlink_offsetgt
ltdownlink_length unitbytegt25lt/downlink_lengthgt
  lt-- Applied transformations --gt
ltpropertygtpn_decodedlt/propertygt
ltpropertygtcompressedlt/propertygt lt-- Just for
example --gt   lt/blockgt
12
Timestamp
13
Timestamp - example
ltblock typetime_stampgt  
ltoffsetgt2lt/offsetgt   ltfacilitygt
ltorganizationgtESAlt/organizationgt
ltsitegtFUCINOlt/sitegt
ltcountrygtITALYlt/countrygt ltsystem
type"software"gt
ltnamegtTMFRlt/namegt
ltreleasegt1.4.0lt/releasegt lt/systemgt
lt/facilitygt lt/blockgt
14
Quality flag
ltblock typequality_flaggt ltlength
unitbitgt1lt/lengthgt lt/blockgt
15
ERS example
ltsignal_datagt ltsubset source"ERS-2-1999-
03-12T093812.354666-1999-03-12T094752.223553.1
.dat"/gt ltstartgt1999-03-12T093712.354666lt/
startgt ltstopgt 1999-03-12T094652.223553lt/st
opgt   ltblock name"Signal Data Record"
type"composite"gt ltoccurencegt6541lt/occurencegt  
ltblock name"Frame 0" type"telemetry_map"gt
ltlengthgt253lt/lengthgt ltdownlink_offsetgt3lt/dow
nlink_offsetgt ltdownlink_lengthgt253lt/downlink_
lengthgt lt/blockgt   ltblock name"Frame 1-28"
type"telemetry_map"gt ltlengthgt253lt/lengthgt
ltoccurencegt28lt/occurencegt  
ltdownlink_offsetgt259lt/downlink_offsetgt
ltdownlink_lengthgt253lt/downlink_lengthgt
lt/blockgt lt/blockgt lt/signal_datagt
16
The Data Request Broker - DRB
17
DerbySoftware
DRB
extension
18
DRB architecture
 
Applications
XQueryscripts
Data Request Broker (DRB)
XQuery Engine
Interface
Facilities
Schema
XML
File
SDF
HDF
Implementations
XML Schema
Directories Files
XMLdocs
HDFfiles
Binary files
Data sources
ENVISAT-PDS Formats Landsat 5/7 CEOS, Fast SPOT
123-4 etc.
CEOS ICF SPOT 5 - DIMAP
19
Derby software(demo)
20
Application 1 Sharing knowledge description
ESA CAOControl Authority Office Version
management
ESA IndustryProcessor design in ground
segments Validation, non regression
ESA PDCCLong loop Quality Control
ENVISAT AATSR XML Schema
ENVISAT MERIS XML Schema
ESA IndustryFormat designiterative loop
ESA Ground segmentsProduct Quality Control
ENVISAT ASAR XML Schema
ERS SAR XML Schema
Sciences communityMulti-disciplinary approach
Other agenciesArchive interchange
End usersData display, analysis
21
Application 2 Towards a generic transcription
1 Physical logical transcription
22
Application 2 Up to a generic transcription
2 - Logical transcription (DRB)
23
Application 2 Up to a generic transcription
3 - Generic transcription
24
Thank you !