Bild 1

1
Delay Tolerant Multimedia Communication
Johan Kristiansson Computer Science and
Electrical Engineering Luleå, 2006-02-14
2
Agenda

• Background
• Who am I? Where do I come from?
• My research/thesis
• The C4 Project
• Delay Tolerant Multimedia ideas
• Questions

3
Who am I?

• Johan Kristiansson
• Ph.D student at Computer Science and Electrical
  Engineering
• Division of Information and Communication
  Technology (ICT)
• The Media technology research group
• Mobil multimedia research
• Applied research

4
Media technology

• ...a young, dynamic and interdisciplinary team
  focusing on human communication and awareness.
• Roots in Software Engineering (1994)
• Seminal work in multicast, real-time audio/video,
  congestion control, e-meetings and telepresence
• The mStar environment (1997)

5
E-meetings

• Marratech spin-off from Media Technology (1998)
• We still have source code access for further RD

6
Research vision

• Always-Best-Communication
• Allow users to seamlessly communicate anytime,
  anywhere, and from any device using any network
• Transparent and easy to use
• Try to make the best out of each situation

7
Simple scenario

• Session mobility
• A user is late for an online meeting
• The system knows this from the users calendar
• The system automatically dials the users mobile
  phone
• Audio participation

8
Simple scenario (contd)

• The user reaches her office
• This is noted by location awareness
• Automatically joins the online meeting
• Asks the user where she wants the audio
• In the mobile, PC audio or desktop phone?
• User selects desktop phone on the PC screen and
  the call is transferred from the mobile

9
Delimitation

• The interface between multimedia communication
  applications and networks

Application layer
New way to use multimedia Application adaptation
Session layer
Transport layer
Network layer
Link layer
Middlewares
Physical layer
10
Research problems

• Host mobility
• How to preserve connectivity while changing IP
  address?
• How to automatically trigger a handover?
• What kind of data should be used for making the
  decision?
• How should the solution be designed in order to
  be deployable?
• Network heterogeneity
• How to manage bandwidth variations while also
  considering variations in demand for bandwidth?
• Disconnectivity
• How to support multimedia communication if
  network delay is substantially long?
• How to take advantage of delay tolerant networks?
• Session mobility
• How to preserve connectivity while changing
  device?
• Which media devices should be used?
• When should a new media device be selected?
• What kind of data should be used for making the
  decision?

11
C4

• Communication Concept for Challenging Contexts
• Extreme physical environment
• Humidity, chill, heat, noise, dirt, vibrations,
  bright light etc.
• Overwhelming tasks/stress
• Not be able to use hands, eyes etc.

12
C4

• Problems
• Lack of suitable interaction technology
• Insufficient infrastructure for digital
  communication
• Lack of remote sensing/remote operation
  capabilities
• Field relief
• Minimize the need for ICT attention
• Minimize equipment size/weight
• Minimize interaction effort
• Partners from local steel/mining industry
• SSAB, LKAB, ...

13
Collaborative Working Environment (CWE)

• A shared Whiteboards for mobile phones
• Interact around a shared image
• Camera phones
• Distribute documentation (e.g. maps)
• Enhance communication using meta data
• E.g. the location of the user
• Master thesis project
• SSAB
• Use resources in the background
• E.g automatically switch to a desktop PC in the
  control room

QTek9100 Armor case
14
Can CWE be used in SNC/Crocopil?

• Interact around a shared map
• Interact around a photo/document
• This is more than just a image and an arrow
• Interactive multimedia presentation
• Audio and video embedded
• What about network delay?
• Share multimedia recordings?
• Interoperability with legasy systems?
• Middleware

15
Introduction

• Delay Tolerant Multimedia

16
Multimedia communication
Network
Sockets
Sockets
Operating system
Operating system
17
Multimedia communication
Sockets
Sockets
OS
OS
Multimedia gateway
Sockets
Sockets
OS
OS
18
Multimedia communication
Sockets
Sockets
OS
DTN Middlewar
DTN Middleware
OS
Multimedia gateway
Sockets
Sockets
OS
OS
19
Multimedia communication
Catch up
Sockets
Sockets
OS
DTN Middlewar
DTN Middleware
OS
Multimedia gateway
Sockets
Sockets
OS
OS