Structured Media for Media Integration

1
Structured Media for Media Integration
Document Authoring

• Tien TRAN_THUONG and Cécile ROISIN
• Project OPERA - INRIA
• Grenoble - France

2
Work Context and Objective

• Multimedia Document
• Set of basic media audio, video, text, image,
  HTML, etc.
• Multimedia document model the way to integrate a
  set of basic media in time, space and hypermedia
  ? Madeus language
• Authoring presentation system for multimedia
  documents ? Madeus editor
• Objective semantic media fragment integration
  and authoring more complex and efficient documents

• Structured media

3
Current media fragment integration

• Anchor and Area elements
• Decompose media into spatial/temporal segments
  for hypermedia and fine-grained synchronizations
  (CMIF, HyTime, SMIL)
• Ex Area in SMIL2.0
• ltvideo src"http//www.inrialpes.fr/operaVideo"gt
   
• ltarea id"Madeus"
• begin "5s" end "7s"
• coords "84, 249, 188, 272"
• href "Madeus-Editor.html" /gt
• lt/videogt

• The fragment attribute of the Area element
  provides naming facilities for external
  structured media
• ltarea fragment"Madeus-frag" 
• href"Madeus-Editor.html" /gt

4
Structured media

• Atomic media is a media node in a document that
  refers to a media content
• Structured media is a media node in a document
  that refers to a media content and includes or
  refers to a structure description of that media
  content

5
Multimedia content description

• DCMES Dublin Core Metadata Element Set
• RDF Resource Description Framework
• Mpeg7 Multimedia Content Description Interface
• Need a multimedia content description model for
  composing multimedia document

6
Experimentation in Madeus
Media structure description

• Structured video sequence, scene, shot,
  videoEvent, videoObject, etc.
• Structured audio speech, music, sound,
  audioEvent, audioObject, etc.
• Structured free text word, phrase, sentence,
  paragraph, etc.

7
Authoring multimedia documents
Video
Image
Media integration
Audio
Free text
Media content
Multimedia document
8
Conclusion and Perspectives

• An authoring tool for complex multimedia
  presentations
• Export to presentation-oriented formats
• Fragments authoring for media (Image, Audio, Free
  text)
• Import of multimedia content description
  standards (Mpeg7)
• Need for media analysers to be integrated in my
  tool