Hypermedia Presentation Generation on the Web

1
HypermediaPresentation Generationon the Web

• Lynda Hardman
• Jacco van Ossenbruggen
• CWI Amsterdam

2
(No Transcript)
3
(No Transcript)
4
Presentation Generation
Correct Relevant information
convey
User
5
Tailored presentation
6
Three ingredients
Content
7
Content of example
Genre paintings, drawings or prints depict people
in their everyday surroundings at home, in a
café or at work. They appear to be painted from
life, but in reality were usually thought up in
the artist's studio. Sometimes (but not always!)
they contain a moral lesson. In some works the
message is clear, in other cases the viewer has
to make an effort to interpret the picture.
Often, however, these household scenes are simply
decorative paintings designed to entertain and
amuse.
8
Three ingredients
Presentation structure
Content
9
Presentation structure of example
Genre Vermeer
title
examples
description
Genre paintings, drawings or prints depict people
in their everyday surroundings at home, in a
café or at work. They appear to be painted from
life, but in reality were usually thought up in
the artist's studio. Sometimes (but not always!)
they contain a moral lesson. In some works the
message is clear, in other cases the viewer has
to make an effort to interpret the picture.
Often, however, these household scenes are simply
decorative paintings designed to entertain and
amuse.
10
Three ingredients
Aesthetics
Presentation structure
abcdefghij abcdefghijklmn ABCDEFGHIJK abcdefghijkl
m abcdefghijklm
Content
11
Aesthetics of example
Fonts
Layout
Colours
Colours
12
Tailored presentation
13
One size doesnt fit all
14
What we need is
Correct and relevant information

• presented to the user
• conveying underlying relations in the subject
  matter
• at a suitable level of detail
• in the time available to the user
• using appropriate media
• in an appropriate style
• making optimal use of the delivery context

15
Create models

• Need
• Convey underlying relations
• Suitable level of detail
• Time available to user
• Appropriate media
• Appropriate style
• Device characteristics

• Knowledge of
• Domain
• Discourse
• User task
• Media characteristics
• Graphic design
• Device capabilities

16
Encyclopaedia
17
Storyteller
18
Create models

• Need
• Convey underlying relations
• Suitable level of detail
• Time available to user
• Appropriate media
• Appropriate style
• Device characteristics

• Knowledge of
• Domain
• Discourse
• User task
• Media characteristics
• Graphic design
• Device capabilities

to drive the creation of presentations
19
Design dependencies
Aesthetics
Presentation structure
abcdefghij abcdefghijk ABCDEFGHIJK abcdefghijk abc
defghijk
Content
20
Presentation structure depends on content
21
What is the Web?

• A standard means of
• locating information (URI)
• describing documents (HTML, XML)
• transferring documents (HTTP)

22
What is Web Multimedia?

• A standard means of
• locating media items (URI)
• describing multimedia documents (SMIL)
• including timing (XHTMLTIME, SVG)

23
What is the Semantic Web?

• A standard means of
• labelling connections (RDF) among objects
  (URI)
• categorising objects and their connections (RDF
  Schema)
• specifying constraints on the connections and
  the objects (OWL)

24
Cuypersmultimedia generation engine
MMDB
MetadataDB
Cuypers Engine

• Demo

25
Cuypers Knowledge Sources
User Query
MMDB
MetadataDB
Cuypers Engine
26
Example scenario

• User is interested in Rembrandt and wants to know
  about about the chiaroscuro technique
• System responds with textual explanation of the
  technique and a number of example images of its
  application in Rembrandts paintings

27
Example - Annotated SMIL
Combine Content text, images Document
structure SMIL timing, layout,
links "Message" Rembrandt is-a painter
28
Using an existing ontology

• See http//www.cwi.nl/media/semantics/
• lt?xml version1.0?gt
• lt!-- taken from http//www.ics.forth.gr/proj/isst/
  RDF/RQL/rql.html --gt
• ltrdfRDF xmllangen
• xmlnsrdfhttp//www.w3.org/1999/02/22-rdf-synta
  x-ns
• xmlnsrdfshttp//www.w3.org/TR/2000/CR-rdf-sche
  ma-20000327
• xmlnsgt
• ltrdfsClass rdfIDArtist/gt
• ltrdfsClass rdfIDArtifact/gt
• ltrdfsClass rdfIDMuseum/gt
• ltrdfsClass rdfIDPaintergt
• ltrdfssubClassOf rdfresourceArtist/gt
• lt/rdfsClassgt
• ltrdfsClass rdfIDPaintinggt
• ltrdfssubClassOf rdfresourceArtifact/gt
  
• lt/rdfsClassgt
• ...
• lt/rdfRDFgt

29
Embedding RDF in SMIL - I

• ltsmil xmlns"http//www.w3.org/2000/SMIL20/CR"gt
• ltheadgt
• ltmeta name"generator" content"CWI/Cuypers
  1.0"/gt
• ltmetadatagt
• ltrdfRDF xmllang"en"
• xmlnsrdf"http//www.w3.org/1999/0
  2/22-rdf-syntax-ns"
• xmlnsoil"http//www.ontoknowledge
  .org/oil/"
• xmlnsmuseum"http//ics.forth.gr/.
  ../museum.rdf"
• ltmuseumMuseum rdfID"Rijksmuseum" /gt
• ltmuseumPainter rdfID"Rembrandt"gt
• ltmuseumfnamegtRembrandtlt/museumfnamegt
• ltmuseumlnamegtHarmenszoon van
  Rijnlt/museumlnamegt
• ltmuseumpaints rdfresource"apostlePau
  l" /gt
• lt/museumPaintergt
• ltmuseumPainting rdfabout"apostlePaul"gt
  
• ltmuseumexhibited rdfresource"Rijksmu
  seum" /gt

30
Embedding RDF in SMIL - II

• ltmuseumPainting rdfabout"apostlePaul"gt
• ltmuseumexhibited rdfresource"Rijksmu
  seum" /gt
• ltmuseumtechniquegtchiaroscurolt/museumte
  chniquegt
• lttokenpainted-by rdfresource"Rembran
  dt" /gt
• lt/museumPaintinggt
• lt/rdfRDFgt
• lt/metadatagt
• ...
•   lt/headgt
• ltbodygt
• ltpargt
• lttext region"title" src"...query to MM
  DBMS..."/gt
• lttext region"descr" src"..."/gt
• ltseqgt
• ltpar dur"10"gt ... 1st paintingtitle ...
  lt/pargt
• ltpar dur"10"gt ... 2nd paintingtitle ...
  lt/pargt
• ltpar dur"10"gt ... 3rd paintingtitle ...
  lt/pargt
• ltpar dur"10"gt ... 4th paintingtitle ...
  lt/pargt
• ltpar dur"10" id"apostlePaul"gt

31
Marked-up presentation

• ltmuseumPainting rdfabout"apostlePaul"gt
• ltmuseumexhibited rdfresource"Rijksmuseum"/gt
  ltmuseumtechniquegtchiaroscurolt/museumtechniquegt
• lt/museumPaintinggt
• lt/rdfRDFgt
• lt/metadatagt
• ...
•   lt/headgt
• ltbodygt
• ltpargt
• lttext region"title" src"..."/gt
• lttext region"descr" src"..."/gt
• ltseqgt
• ltpar dur"10"gt ... lt/pargt
• ltpar dur"10"gt ... lt/pargt
• ltpar dur"10"gt ... lt/pargt
• ltpar dur"10"gt ... lt/pargt
• ltpar dur"10" id"apostlePaul"gt
• ltimg region"img" src"..."/gt
• lttext region"ptitle" src".."/gt

32
Cuypers the bad news

• Currently all our design knowledge is
• implicit and hidden in the generation rules
• lost in the generated Web presentation
• not reusable for other Web applications/sites

We need the Semantic Web
33
Topia
34
Conclusions

• Generating multimedia presentations requires
• making design dependencies explicit
• taking these dependencies into account
• Semantic Web has the potential to
• encode knowledge we use
• reuse knowledge already available
• Cuypers and Topia systems
• provide experimentation platforms
• using standard tools and languages as much as
  possible