SMD074 Lecture 1 Peter Parnes pepparcdt'luth'se

1
SMD074 Lecture 1 Peter Parnespeppar_at_cdt.luth.se
2
Who am I?

• Dr Peter Parnes
• Peppar_at_cdt.luth.se
• http//www.cdt.luth.se/peppar/
• 0920/72421
• 070/6614567
• A3309
• E-meeting in the CDT session
• ICQ (4208035)

3
Course Goal

• Understanding the area of distributed multimedia
• Media coding
• Real-time communication
• Architectures for distributed multimedia
  applications
• And much much more -)

4
Course Overview

• Three major parts
• Lectures
• 9 in total
• Covers material from the book
• Also additional material will be presented
• Slides available on-line
• Some guest lectures
• Seminars
• ....
• Laborations
• ....

5
Seminars

• Groups of 3
• Find an interesting subject
• Do a litterature study
• Write a scientific report
• Verbal presentation (9 minutes long)
• Subject deadline 010916
• More info on the course page(http//www.cdt.luth.
  se/peppar/kurs/smd074/)

6
Laborations

• Groups of 3
• 3 laborations in total
• Presented in written reports (on the web) and as
  running applications when applicable

7
Laboration 0

• Laboration 0
• Goal Get introduced to the Java Media Framework
• http//www.javasoft.com/products/java-media/jmf/
• No hand in!
• Future labs build on JMF so do this and save
  time!!
• More info on course page soon.

8
Try out!

• Things to test
• How to grab live video and display in on the
  screen.
• How to record and playback audio.
• How to send media over the net using RTP.
• http//java.sun.com/products/java-media/jmf/2.1/so
  lutions/

9
Deadlines!!!

• All parts in the course will have deadlines.
• Honour them and get the grade you deserve.
• Be on time for lectures!!!
• PLEASE!

10
E-Mail List

• Join the course e-mail list.
• Announcement, course news, questions etc.
• Do not hesitate to use it for your questions!
• Subscribe smd074-request_at_cdt.luth.se
• Post smd074_at_cdt.luth.se
• Archive on the course page.

11
Grade

• Final grade
• 25 written exam 25 seminars
• 50 labs

12
The Book

• Loads of text...
• Reading instructions on the course page...

13
Questions?

• Questions now?
• Please ask question at any time in the course!!!!
  
• Protest!! Interact!!
• Send suggestions via email (to the list or
  directly to me).
• Do not be afraid to critique me -)

14
Multimedia ???

• What is multimedia???

15
What is Multimedia?

• Multimedia is a very broad area
• Mainly undefined with many different views.
• Multi many
• Media plural of medium middle, center,
  intermediary
• Multiple intermediaries
• Covered in chapter 1

16
The Information Field

• The word multimedia is used in various fields in
  information handling
• Storing and processing in computing
• Production in publishing
• Distribution in mass media
• Transmission in telecommunications
• Presentation in interaction between people and
  systems
• Perception in peoples interaction with outside
  world

17
Digital Multimedia

• What is digital multimedia?
• Digital multimedia is the field concerned with
  the computer-controlled integration of text,
  graphics, still and moving images, animation,
  sounds, and any other medium where every type of
  information can be presented, stored and
  processed digitally.
• F. Fluckiger, Page 5

18
Multisensory Systems

• Humans are multisensory.
• Sight, hearing, smell, touch and taste.
• Visual media
• Audio media
• Multimedia Systems
• ! Multisensory Systems

19
Multisensory Systems

• Advantages of multisensory systems
• Appear more natural and friendly
• Redundant information more possible
• Complementary information improves memorization
• Emotional information easier to convey

20
Classification of Media
Time/space nature
Continuous (time-based)
Animation
Moving Images
Sound
Discrete (space-based)
Still Images
Text
Graphics
Origin
Captured from real-world
Synthesized by computers
Figure 1.1 Conventional classification of media
types
21
Networked Multimedia

• This course is really about networked
  multimedia.
• Two main categories
• Genuinely networked applications
• Client-Server model based applications

22
Example Desktop audio/video
23
Chapter 2

• Integrating Digital Information

24
Multimedia Systems

• Essential characteristics of multimedia systems
• Computer controlled
• Integrated
• Digitally represented information
• Optionally offer interactivity

25
Computer Controlled

• Rather obvious
• One or several computers have to be involved in
  the presentation of the information.
• E.g. a CD-player is not a multimedia system.

26
Integration

• A multimedia system should handle producing,
  storing, carrying and presenting information in
  an integrated way.
• E.g. Computer Integration
• E.g. Network Integration

27
Integration
Presentation integration
Storage integration
CD-ROM
video window
Magnetic Disk
text window
text
Capture integration
Network integration
video camera
Single Network
integrated microphone
28
Digital Representation

• What is digitization?
• The transformation from an analog signal to a
  digital signal
• An analog signal varies continuously and is said
  to be analogues to the measured value

29
The Digitization Process
sampled signal
analog signal
Sampler
Quantizer Coder
digitized signal
30
Conversion
digital signal
analog signal
A/D converter
(011001101 ...)
D/A converter
analog signal
31
Why Digital Representation?

• All types of information can be represented as
  bits
• Can be moved over digital networks
• No loss in copy
• Easy to maintain the information error free

32
Drawbacks of Digital Rep.

• Distortion
• Might require high bit-rates to transfer
• Fast networks...
• Large storage needed...

33
Digital Representation
Memorandum This is a note to inform you that ...
one page formed of digital characters
4 000 bytes
50 000 bytes
Memorandum This is a note to inform you that ...
same printed page scanned and digitized
34
Two Modes of Presentation

• Two basic modes of presentation
• Passive or Linear
• TV, movies, radio
• Interactive or Non-linear
• The receiver can modify the presentation
• Time
• Order 4 degrees of customization
• Speed
• Form
• Newspaper, book, computer game

35
Examples

• PocketPro
• MPEG4

36
Handheld Audio/Video
37
mPocketPro
38
MPEG-4 Video
39
Questions?

• ?

40
Chapter 3

• Media definitions
• Media parts
• Text, graphics, images, video, animation and
  sound.
• Might sound trivial but notions needed.
• Most from the human-computer interaction HCI
  world.

41
Text

• This is an an example of rich text.
• Characters can have different styles and their
  pitch is variable.
• They may also us different fonts.
• They may also respect certain formatting
  rules.

This is an unformatted text also called plain
text. All the characters have the same style and
font and their pitch is the same. Regular human
computer interfaces use plain text. An advantage
is that v e r t i c a l a l i g n m e n t
is easier.
42
Graphics vs. Images
Graphics
Images

• graphics are revisable documents
• the document format must retain structural
  information
• the semantic content is preserved in the
  representation
• described as objects

images are not revisable the document format is
unaware of any structural information the
semantic content is not preserved described as
bitmaps formed of individual pixels
43
Still Images

• Format bitmap
• Picture elements pixels
• Pixel/Amplitude depth
• 1,8,16,24,32 bpp bits per pixel
• Common formats JPEG, GIF, PNG, TIFF
• Compression of images

44
Moving Images

• Movies consists of a series of frames or still
  images
• Frame rates and human perception
• lt10 sequence of still images
• 10-15 jerky effect
• gt15 movie effect

45
Frame Rates

• Movies 24 fps
• TV
• American 30 fps
• European 25 fps
• HDTV 60 fps

46
Sound

• Speech vs. Non-speech sounds
• and computers
• Speech coding
• Use computers to communicate with humans
• Speech recognition and understanding
• to computer
• Speech synthesis
• from computer

47
Enabling Technologies

• Chapter 4
• We need some technologies to be able to do
  networked multimedia )
• Computers....
• CPU, RAM, storage space, display etc.

48
Central Memory
Memory bus
network
CPU
DMA
Bus Interface
Disk controller
Comm. Interface
Peripheral bus
Audio player
Audio A/D
Video compression
VCR
Display controller
Video A/D
49
Transmission

• Terrestrial transmission
• Metallic cables
• Twisted Pair, TP (shielded or unshielded)
• Optical fibers
• Modulated light

50
Aerial Transmission

• Surface transmission
• Radio, microwave, IR-light, laser
• Radio up to 200 Mbps
• Radio affordable at 11 Mbps
• Satellite transmission
• High delay, 100-300 ms

51
Base band Transmission

• Apply the signal to be sent directly on the
  cable.
• Only one bit can be sent at one time.

52
Synchronous Time Division
fixed time slots dedicated to data from A, B and
C
A
B
C
A
B
C
A
B
C
time
Synchronous Time Division Multiplexing System
Input line A
Input line B
Output line
Input line C
53
Asynchronous Time Division
variable time slots allocated to data from A, B
and C
A
B
C
B
C
A
c
C
time
Asynchronous Time Division Multiplexing System

Input line A
Input line B
Output line
Input line C
54
Broadband Transmission

• Modulate a carrier signal
• E.g. Change the amplitude of the carrier
• Allows us to send several signals in the same
  wire at the same time.
• We use a
• Modulator-demodulator modem

55
Network Topologies

• Full connection
• Star topology
• Tree/Mesh topology
• Routers and switches needed as junctions
• Bus
• Send the signal in both directions to everybody
• Ring

56
Bus Topology
station transmitting at a given instant
destination station
flow of transmitted data
57
Ring Topology
station transmitting at a given instant
flow of transmitted data
destination station
58
Tree structures

• Internet!
• Routers, switches, hubs
• Packets...

59
Communication Protocols

• Computers need a predefined language to
  communicate,
• Just like humans!
• Thus, protocols!
• Protocols are layered into stacks
• See 4.3.5
• Suites Internet Protocol, OSI, DNA, SNA

60
Packet vs. Circuit switching

• Circuit
• Physical or virtual path created
• Dedicated bandwidth per circuit
• Wastes bandwidth
• Packet
• Chop up data into packets
• Send and forward them when necessary
• Multiplexing

61
Connections...

• Connection-oriented
• Create a virtual connection
• The network knows that A and B want to
  communicate
• Connectionless
• Just send data
• Network forwards the data

62
L,C,M,W,PAN

• Local Area Network LAN
• Campus Area Network - CAN
• Metropolitan Area Network MAN
• Wide Area Network WAN
• Personal Area Network PAN

63
End chapter 4

• Questions?