BEST : a workbench to simplify data user life

1

• BEST a workbench to simplify data user life

2
Table of contents

• Context
• Tools vs. Data life cycle
• Success story
• Near future
• Demonstration
• Conclusion

3
Context
4
Context

• Relies on two recommendation EAST and DEDSL
• EAST technology initiated by the CNES in
  1989-1990.
• EAST (Enhanced Ada subset)
• The data description language EAST specification
• EAST designed in the framework of CCSDS Panel II
  (CCSDS 644.0-B-2 Nov 2002)
• ISO standard ISO 158892003
• Used to describe data structure on its medium
• DEDSL
• Data Entity Dictionary Specification Language
• DEDSL (Data Entity Dictionary Specification
  language) designed in the framework of CCSDS
  Panel II (CCSDS 647.3-B-1 Jan 2002)
• Based on PVL or XML/DTD Syntax
• Used to describe data semantics
• Each data field or type is described through
  attributes (standard ones or user purpose ones)

5
Data life cycle
6
BEST tools presentation
7
BEST (Beyond EAST)

• BEST framework offers a simple and intuitive
  access to the suite of tools through a user
  friendly GUI .
• Highly customised by each user according to his
  specific needs and preferences Easy way to add
  plug-ins sharing models and data.
• The Project Management support provides a virtual
  organisation of the file system allowing to
  gather in one bundle all the files related to a
  given project/mission (data models, data files,
  documentation, etc.).

8
Modelling
9
OASIS Modeller

• Modeling data through a performing graphical user
  interface.
• Definition of the logical model i.e. the data
  structure, the data type, the range of possible
  values, etc.
• Definition of the physical model i.e. encoding
  format of the data on the medium.
• Definition of the semantic information related to
  a data format.
• Based on XML internal format (XML-IF).
• OASIS Modeller provides the following features
• Specifying real and integer formats for ascii
  data,
• Associating default values to a given element of
  the data model,
• Defining elements discriminated or elements size
  by a computed value (calculation capabilities),
• Checking that the syntactic information is
  correctly and exhaustively filled in the data
  model,
• Searching elements in description according to
  any criteria syntactic, semantic,
• Viewing facilities of ASCII files generated by
  the tool,
• Library concept allows the reuse and the
  sharing of predefined types,

10
OASIS Modeller inputs/outputs
11
Generating Simulating
Data
12
DPE (Data Producer Editor)

• The Data Producer Editor (DPE) is a graphical
  tool that provides editing, generating, checking
  features for data described by an EAST
  description
• The DPE provides several functions
• Data model handling tree structure of the data
  model,
• Data product consultation tree view and
  navigation,
• Data product generation advanced generation of
  data products,
• Data product edition edit the content of a data
  product,
• Data checking check if a data product is
  compliant with its EAST model,
• Search capabilities searching elements in a data
  product.

13
DPE (Data Producer Editor)
14
Processing
15
DEQ (Data Extractor Querying)

• The DEQ tool provides editing, extracting
  features throught friendly GUI.
• The Data Extractor Querying tool provides the
  following functions
• Description file handling reads and interprets
  any XML-IF file and display it in a tree-like
  graphical view,
• Data products handling provides the ability to
  read and display data products from several
  sources. The tool also provides the ability to
  navigate through the whole data product,
• XML views Allows to create XML views of the data
  products,
• Queries provide the ability to create and process
  queries upon a data products, search through one
  or more products at the same time,
• Data extraction allows to extract elements from
  data products,
• Batch processing enables users to schedule data
  querying and data extraction at a later time.

16
DEQ (Data Extractor Querying)
17
Utilities

• Comparison Tool
• Compares two versions of a Model (XML-IF) and
  displays the difference in a tree-view or XML
  file
• Data Checker
• Checks a Data (binary or ascii) against an EAST
  Model.
• ASCII Dump
• Generates an ASCII representation of Data Text
  or XML structure.

18
Post Processing
19
PPT (Post Processing Tools)

• XML Tagging
• Generates a customized XML file from extracted
  data
• Quick Look
• Smart presentation of extracted Data
• Visu2d
• Draws some graphs from Data

20
Distribution
21
Packager and Web

• The Packager component is intended to provide
  means to enable the dissemination of data
  products together with their documentation and
  descriptions. Provided feature
• Packaging capabilities
• Compression capabilities
• The Web API provides remote access to a subset of
  the BEST software functions whatever the target
  platform and without any specific installation of
  DEBAT. Some of the features are described below
• User Authentication
• Descriptions/Data product upload, reading and
  checking
• Data product generation
• Data search
• Extraction
• XML transformation

22
Existing BEST plugins

• 2 additional plug-ins based on XML
• ALADIN XML description comparisons (XML-DEDSL
  and XML Schema)
• SCRIBE XML post processor transforming XML data
  descriptions into ICDs (Word or HTML)
• Both are in test in PLEIADES context to produce
  and compare ICD versions
• SCRIBE is already operational on Helios project

23
Success story
24
Success story

• The list of project using EAST and DEDSL is now
  quite long...
• Historical projects SPOT (Earth observation),
  SSALTO (altimetry), CDPP (data centre for plasma
  physics), PHARAO (embedded atomic clock), Helios
  II
• Current projects Octave (CNES), Stilo (CNES),
  ATV (CNES), Atmospheric Balloons (CNES)
• Projects evaluating BEST Goce (ESA), Aeolus
  (ESA), Envisat/Cryosat (ESA), Pleiades (CNES)

25
Near future
26
Near future

• BEST team invests a lot on the XML technologies.
• The modeller could help in designing data and
  producing the documentation.
• Tools for XTCE norm studies will be lead on
  OASIS Modeller for modelling description
  following XTCE norm.
• Studies still in progress both in CNES and ESA
  for the ground segment standardisation based on
  XML schema.

27
Demonstration
28
Conclusion
29
Conclusion

• BEST is a generic tool covering the entire data
  life cycle
• BEST software is available on Windows, Linux and
  Unix platforms
• BEST is developed using free technologies and as
  far as possible open source
• BEST is available freely for users under the form
  of a binary distribution
• Contacts
• For any BEST/EAST/DEDSL question there is a
  hot-line at
• support.east_at_cnes.fr
• To get BEST version 1.2.1 and related information
  
• http//debat.c-s.fr
• To get the previous versions
• logiciels.cnes.fr