Multimedia Communications: Overview

1
Multimedia CommunicationsOverview

• mmc1.01

2
Grading Algorithm

• Mid Term Exam 30
• Second Term Quiz 30
• Project 40
• Exam and quiz are both closed-book
• Project is the simulation of an end-to-end
  system
• for robust digital communication of a media
  signal
• mmc1.02

3
Ubiquitous Multimedia
Media Processing
Networking
Computing
mmc1.03
4
The Dimensions of Multimedia

• Text
• Data Files
• Images
• Graphics
• Handwriting
• Video
• Animation
• Speech
• Audio
• mmc1.04

5
Key Dimensions of Media Processing

• Media Compression
• Media Synthesis
• Media Recognition
• mmc1.05

6
State of the Art in Audiovisual Signal Processing

• Compresssion Synthesis
  Recognition
• Speech
  
• Audio
  
• Image
  
• Video
  
• mmc1.06

7
Key Dimensions of Comm. Technology

• Antenna Diversity and Space-Time Processing
• Channel Equalization
• Bitstream Interleaving
• Multiple Access and Interference Cancellation
• Modulation and Error Protection
• mmc1.07

8
Key Dimensions of Networking

• Media Access Protocols
• Error Control ARQ
• Admission Control, Scheduling
• Routing, Multicasting
• Mobility Management and User Tracking
• Protocols for ATM, IP and Hybrid Networks
• QoS Management
• mmc1.08

9
Some Applications of Multimedia Communications

• Cellular Telephony
• Digital Audio Broadcast
• Internet Video
• Wireless Messaging
• Telecollaboration
• Digital Libraries
• mmc1.09

10
Research Challenges

• Defining Metrics of Performance
• Discovering Fundamental Limits
• Joint Designs
• System-Level Optimization
• Q,Complexity, Cost, Delay, Interactivity
• bps bpspHz bpsphzpmmm asrwer ttsq qoc
• jspvid jsac jsacnw
• jscwater
• mmc1.10

11
Goals of Course

• Exposure to
• Algorithms
• Standards
• Complete End-to-End Systems
• Research Frontiers
• mmc1.11

12
Multimedia Communications System
Network
Encoder
Decoder
Media Signal
Media Signal
Transducer
Transducer
HUMAN
HUMAN
Media Signal
Media Signal
Human-Computer
Interaction
COMPUTER
mmc1.12
13
MMC Activity at G-Tech

• GRA Clusters
• Yamacraw Research
• GVU Center
• Multimedia Laboratories
• Courses in DSP, MM-NW
• mmc1.13

14
Roadmap of Course Part 1

• 1. Overview of Course
• 2. Overview of Media Compression
• 3-4 Speech Compression
• 5. Audio Compression
• 6. Image Compression
• 7-8 Video Compression
• 9 Seminar June 13
• 10 Mid-Term Exam June 15
• 11 Seminar June 20
• mmc1.14

15
Roadmap of Course Part 2

• 12-13 Models of Channels and Networks
• 14 Standards for Wired Wireless Networks
• 15-16 Principles of Robust Communications
• 17 Second-Term Quiz July 13
• 18 Voice User Interface
• 19 Project Submission July 20
• 20 Visual User Interface
• 21 Research Directions
• 22 Final Exam Aug 1
• mmc1.15

16
Reading Material Books

• V. Madisetti and D. Williams, "The Digital Signal
  Processing Handbook," CRC Press and IEEE Press,
  1997
• D. J. Goodman, "Wireless Personal Communications
  Systems," Addison-Wesley, 1997
• R. Steele, "Mobile Radio Communications," Pentech
  Press, 1992
• W. Stallings, "Data and Computer Communications,"
  Macmillan, 1994
• S. Haykin, "Digital Communications," John Wiley,
  1988
• H. V. Poor and G. W. Wornell, "Wireless
  Communications," Prentice Hall, 1998
• F. D. Natale and S. Pupolin (eds) "Multimedia
  Communications," Springer, 1999
• Midterm Exam Madisetti
  (chapters on coding)
• Second Term Quiz
  Goodman (chapter on GSM)
• mmc1.16

17
Reading Material Papers

• N.S.Jayant, High Quality Networking of
  Audiovisual Information, IEEE Comm Magazine,
  Sept 1993
• R.V.Cox et al, On the Applications of Multimedia
  Processing to Communications,Proc IEEE, May 98
• L.R.Rabiner and B.H. Juang, An Introduction to
  Hidden Markov Models, IEEE-ASSP Mag., Jan 96
• N.S.Jayant etal , Signal Compression Based on
  Models of Human Perception, Proc.IEEE, Oct 1993
• N.Seshadri etal, Advanced Techniques for
  Modulation,Error Correction ,Diversity, ATT J,
  July 93
• N.S.Jayant etal, Multimedia Technlogy Dimensions
  and Challenges, ATT J, Sept-Oct 1996
• SPECIAL ISSUES OF IEEE COMMUNICATIONS MAGAZINE
• Communications in the Medical Environment July
  1996
• Multimedia Modems December 1996
• Residential Services June 1997
• Wireless Video June 1998
• Multimedia Communications Standards September
  1998
• Quality of Service January 1999
• Midterm Exam Jayant Oct93 Cox May98
  (Sections on Coding)
• Second Term quiz Com Mag Special Issues
  July 96 June 98 Jan 99

18
Reading Material Websites

• www. mpeg.org
• www.cc.gatech.edu/Mostafa.Ammar/6385
• mmc1.18