Video and Image Internet Broadcasting Systems

1
Video and Image Internet Broadcasting Systems

• Research Projects
• in Multimedia Laboratory at Florida Atlantic
  University

2
Projects and Their Applications

• IP Simulcast - An Innovative Broadcasting
  Technique Over the Internet
• XYZ Video Encoding - A New Video Compression
  Technique
• A Fast Content-Based Multimedia Retrieval
  Technique
• Interactive Progressive Encoding System

3
Internet Broadcasting or
Webcasting

• Broadcasting multimedia data (audio and video)
  over the Internet - from a server (sender) to a
  large number of clients (receivers)
• Applications include radio and television
  broadcasting real-time
  broadcasting of critical data
  distance learning
  videoconferencing
  database replication
  electronic
  software distribution

4
Webcast Audio Examples

• AudioNet - has mainstream content from Major
  League Baseball to live jazz www.audionet.com
• JamTV - provides daily commercial music news,
  chat, and online music store www.jamtv.com
• LiveConcerts - music concerts and archives old
  shows. www.liveconcerts.com

5
Webcast Video Examples

• C-Span Online - Live video of House and Senate
  events www.c-span.org
• Fox News - www.foxnews.com
• WebActive - news station www.webactive.com

6
Technologies Needed for
Internet Broadcasting

• Techniques and protocols for efficient
  transmission of multimedia data over the
  Internet.
• Real-time audio and video compression techniques
  that provide high compression ratios and high
  quality.

7
Present Approaches in Data Broadcasting
Over the Internet

• IP Unicast - transmits data from a sender to a
  single receiver
• IP Broadcast - transmits data from a sender to an
  entire subnetwork
• IP Multicast - transmits data from a sender to a
  set of receivers that are members of a multicast
  group in various scattered subnetworks

8
IP Unicast

• Many current radio and television broadcast
  applications use unicast data transmission
• Connection-oriented stream transports are used to
  distribute data to each receiver individually.

Clients
Sender
Network
9
IP Multicast

• Sender sends a copy of data to multiple
  receivers, which are members of the same
  multicast group.

10
IP Simulcast - An Innovative Technique
for Internet Broadcasting

• IP Simulcast reduces the server (or sender)
  overhead by distributing the load to each client
  (or receiver)
• Each receiver becomes a repeater, which
  rebroadcasts its received content to two child
  receivers
• The needed network bandwidth for the server is
  significantly reduced

11
Broadcast Pyramid Applied in IP
Simulcast
12
IP Simulcast - An Innovative Technique
for Internet Broadcasting

• IP Simulcast reduces the server (or sender)
  overhead by distributing the load to each client
  (or receiver)
• Each receiver becomes a repeater, which
  rebroadcasts its received content to two child
  receivers
• The needed network bandwidth for the server is
  significantly reduced

13
Characteristics of IP Simulcast

• It is a radically different model of digital
  broadcast, referred to as repeater-server model
• The server manages and controls the
  interconnection of repeaters
• Each repeater not only plays back the data
  stream, but also transmits the data to two other
  repeaters
• IP Simulcast provides guaranteed delivery of
  packets, which is not the case with IP Multicast

14
Comparison With Other
Approaches
15
Pipe Dreams Radio Player
16
XYZ - New Video Compression Technique

• The XYZ video compression algorithm is based on
  3D Discrete Cosine Transform (DCT)
• It provides very high compression ratios and
  excellent video quality
• It is very suitable for real-time video
  compression

17
Forming Video Cube for
XYZ Compression
18
Block Diagram of the XYZ
Compression
19
Key Encoding Equations

• Both encoder and decoder are symmetrical, which
  makes the algorithm suitable for VLSI
  implementation

20
XYZ Versus MPEG
21
Complexity of Video Compression
Techniques
22
XYZ Versus MPEG
MPEG Cr11,NRMSE0.08
MPEG, Motion Est. only Cr27, NRMSE0.14
Original
XYZ Cr45, NRMSE0.079
23
Examples of XYZ Compression
Original
XYZ-compressed Cr51
24
Examples of XYZ Compression
Original
XYZ-compressed Cr110
25
Characteristics of XYZ Video
Compression

• XYZ gives significantly better compression ratios
  than MPEG for the same quality of video
• For similar compression ratios, XYZ gives much
  better quality than MPEG
• XYZ is faster than MPEG (lower complexity)
• XYZ is simple for implementation

26
Applications of the XYZ

• TV phone
• Video broadcasting on the Internet
• Video-on-demand applications
• Interactive TV
• Videoconferencing

27
TV Phone

• Videophone is a box on the top of TV with a small
  camera, modem, and video/audio codec.

28
Design of the TV Phone
29
A Fast Content-Based Multimedia
Retrieval Technique

• Two main approaches in indexing and retrieval of
  images and videos
• Keyword-based indexing and retrieval
• Content-based indexing and retrieval

30
Keyword-Based Retrieval and Indexing

• Uses keywords or descriptive text, which is
  stored together with images and videos in the
  database
• Retrieval is performed by matching the query,
  given in the form of keywords, with the stored
  keywords
• This approach is not satisfactory - the
  text-based description is incomplete, imprecise,
  and inconsistent in specifying visual information

31
New Algorithm for Similarity-Based Retrieval of
Images

• Images in the database are stored as
  JPEG-compressed images
• The user submits a request for search-by-similarit
  y by presenting the desired image.
• The algorithm calculates the DC coefficients of
  this image and creates the histogram of DC
  coefficients.
• The algorithm compares the DC histogram of the
  submitted image with the DC histograms of the
  stored images.

32
Histogram of DC Coefficients for the Image
Elephant
33
Comparison of Histograms of DC Coefficients
34
Example of Similarity-Based Retrieval Using the
DC Histograms
35
Similarity-Based Retrieval of Compressed Video

• Partitioning video into clips - video
  segmentation
• Key frame extraction
• Indexing and retrieval of key frames

36
DC Histogram Technique Applied for Video
Partitioning
37
Example of Similarity-Based Retrieval of Key
Frames Using DC Histograms
38
Interactive Progressive Encoding System

• Users submit requests for imagery to the image
  database via a graphical user interface
• Upon an initial request, a DCT image (version of
  the image based on DC coefficients only) is
  transmitted and reconstructed at the user site.
• The user can then isolate specific regions of
  interests within the image and request additional
  levels of details.

39
Band Transmission in Interactive JPEG System
Based on Spectral Selection
40
Prototype System - IPES and Experimental Results

• Original image Airport

41
Interactive Progressive Transmission in Four Scans
42
Selection of Two Regions
43
Cumulative Number of Transmitted Bits
44
Extracted Images From a Group of Images
45
Applications

• Retrieval and transmission of complex images over
  low bandwidth communication channels (image
  transmission over the Internet, real-time
  transmission of medical images)
• Archiving and browsing visually lossless image
  databases (medical imaginary, space exploration
  and military applications)