Multimedia Digital Libraries

1
Multimedia Digital Libraries

• Sugata Mukhopadhyay
• March 14, 2000

2
Announcement

• Discussion Class Wed 3/15/00
• Review of Prelim

3
Examples

• Archived news broadcasts
• Video
• Text Transcripts
• Recorded lecture archives
• Experience on Demand

4
Challenges

• Quantity of Data
• Isochronous delivery requirements
• Automatic extraction of semantics for indexing
• Searching ability

5
Example Data Size

• Text (1 page) 5K / 1K
• Image (1024x768) 2.3M / 300K
• Voice (1 min) 480K / 60K
• Music (1 min, CD) 10.2M / 1M
• Video (1 min, VHS) 400M / 10M
• Video (1 min, NTSC) 1.6G / 35M
• Video (1 min, HDTV) 4.8G / 200M

6
Example Searching

• Images
• Color Histograms, Color Coherence Vectors
• Audio
• Speech recognition
• Query by humming
• Bird sound recognition
• Video
• Content based retrieval
• Closed captioning

7
Case Study

• The Cornell Lecture Browser
• Demo

8
(No Transcript)
9
Schematic of the Setup
Podium
Seats
Fixed Camera
Tracking Camera
Seats
10
System Dataflow
Classroom
Digital Objects
Synchronize Slide Match Auto Edit Transcode
FEDORA Repository
11
Why use a Digital Library ?

• Presentation form vs stored form
• Archived data delivery must adapt to advances in
  technology
• Access policy enforcement and rights management
• Extensibility of archived data delivery
• (Algorithms we haven't dreamt of)

12
FEDORA

• Digital Object
• Container for aggregating digital material
• Repository
• Service layer for Digital Objects
• Dissemination
• Generic components associating a set of behaviors
  to a Digital Object

13
FEDORA DigitalObject
Extensible Behavior Layer
Primitive Disseminator
Structural Kernel
14
Client communicates with generic requests
GetChapter GetTOC GetPage
15
Object Granularity
Aggregate Object
MetaData
Video1
Video2
16
Thin vs Thick Clients
17
Thin vs Thick Clients II
GetApplet()
18
Adaptability Goals

• Change in internal data representation must not
  impact clients
• New disseminations should be added seamlessly

19
Conclusion

• Multimedia digital libraries present a new set of
  challenges
• BUT
• Leverage off the large body of research in
  traditional digital libraries