Presenting Knowledge on the Semantic Web

1
Presenting Knowledgeon the Semantic Web
Lynda Hardman Semantic Media Interfaces http
//media.cwi.nl
2
(No Transcript)
3
(No Transcript)
4
Long-term goal

• Develop knowledge-intensive models and document
  processing technologies that are able to
• generate coherent multimedia presentations
  tailored to an individual user
• taking into account their preferences,
  abilities, device capabilities and environment.

5
Goals of research

• Understand how to
• incorporate design and discourse knowledge into
  multimedia presentations
• represent this knowledge in Web and Semantic Web
  technologies
• Semantic Web provides
• source content for inclusion in presentations
• a means of expressing knowledge needed

6
From syntax to semantics
Semantics
AmsterdamHypermedia Model
Syntax
Time
7
From syntax to semantics
Semantics
AmsterdamHypermedia Model
Syntax
Time
8
Space/time trade-offs
9
Space/time trade-offs

• Media repository from Rijksmuseum
• Quantitative constraints insufficientusing
  pixel-based positioning
• Qualitative constraints also usedspecification
  of constraints at higher level A not-overlap B,
  B after C
• If insoluble then backtrack to other solutions
  using Prolog
• Joost GeurtsMMM 2001, WWW 2001

10
From syntax to semantics
Semantics
AmsterdamHypermedia Model
Syntax
Time
11
Inferring document structure
12
Rijksmuseum domain model
Art
Theme
Place and Time interval
includes
subClassOf
Artist
Artefact

• First name
• Surname
• Other name
• Synonym
• Year of birth
• Year of death

• Title
• Short title
• Material
• Style period
• Creation year
• Picture

includes
creator
description
description
Presentation

• ID
• Type
• Text

part of
points to
Topia project
Keyword
Presentation part

• ID
• Type
• Keyword text

• Sequence no.
• Title
• Description

contained in
13
Inferring document structure

• Topia
• Rijksmuseum ARIA database -gt RDF
• Clustering on results of query
• Presentation showing table of contents and
  current focus
• Lloyd RutledgeACM Hypertext 2003

14
Semantic graph to presentation
15
Semantic graph to presentation

• DISC
• Rijksmuseum repository of media items
• Semantic graph is not enoughRembrandt married-to
  Saskia also need discourse structuresfor
  deriving grouping, ordering and priorities
• Biography template createdpainter is-a
  profession
• Stefano Bocconi, Joost GeurtsISWC 2003

16
From syntax to semantics
Semantics
AmsterdamHypermedia Model
Syntax
Time
17
(No Transcript)
18
Semantic Web browsing

• Noadster
• Generalised semantic web browsing
• Integrating global and local browsing
• Lloyd Rutledge,WWW 2005

19
From syntax to semantics
Semantics
AmsterdamHypermedia Model
Syntax
Time
20
From syntax to semantics
Semantics
Eculture
AmsterdamHypermedia Model
Syntax
Time
21
MultimediaN Eculture

• Collection of vocabularies in RDF
• AAT, ULAN, TGN
• Artchive images
• Interface for searching and browsing
• http//eculture.multimedian.nl
• Partners
• Guus Schreiber, VU Bob Wielinga Jan
  Wielemaker, UvA

22
Eculture advanced search
23
Eculture search result
24
Eculture single artefact
25
Eculture artefact annotation
26
Scientific challenges

• Making (multimedia) discourse and design
  knowledge explicit
• Expressing re-usable semantics of media assets
• Designing architectures for multimedia
  presentation generation

27
Conclusions Future Work

• From projects described we have learned much
• distinguish stages in process
• make discourse knowledge explicit
• mappings between domain and discourse knowledge
• Explicit user model being worked on
• CHIP user interaction, partner RijksmuseumPassepa
  rtout media installation, partner V2_
• Investigating use of timeline
• to display artefacts to a user, MultimediaN
  Eculture
• Semantic Web Best Practices and Deployment Group,
  Multimedia Task Force
• http//www.w3.org/2001/sw/BestPractices/MM/
• SWUIG Semantic Web User Interface Group

28
This research is supported by

• NWO I2RPIntelligent Information Retrieval and
  Presentation
• NWO NASHNetworked Adaptive Structured Hypermedia
• Telematica Instituut Topia
• ICES KIS MultimediaN Eculture
• Images courtesy of Rijksmuseum, Amsterdam
• Acknowledgements
• Jacco van Ossenbruggen, Frank Nack,Stefano
  Bocconi, Joost Geurts, Lloyd Rutledge,Alia Amin,
  Michiel Hildebrand, Zhisheng Huang