Platform and terminal aspects

1
Platform and terminal aspects
LMGT LOGO
Simão F. Campos Neto Vice-Chair, SG16 (Brazil)
Chair WP 3/16 (Media Coding) Lockheed Martin
Global Telecommunications

• IP-Networking and Mediacom 2004 Workshop
• Session MM3/MM4 Convergence / Interactive
  Broadcast

2
Objective

• Present an overview of ITU-T perspective on
  provisioning Multimedia Services (MM)

3
MM Applications Development
Users
Recommendations for Applications Services (F,T
series)
Interoperability

• Factors
• Users needs
• Market Trend
• System Design
• Architecture
• Interoperable

Common Multimedia Parts, e.g., Coding
(G,H,T-series), Security (X-series), Directory
(X-series)
Integration or Assembling of Multimedia
Parts (Terminal Design J,H-Series)
Media (CS, PS, Cable) Wired/Wireless (ITU and
non-ITU)
Numbering, Charging Specs. (E-series)
4
MM Element Interdependence
User perspective
Equipment/protocol perspective
5
Services
6
MM Service Descriptions
Integration of media components from the users
point-of-view
Service definition and requirements are available
in the F-series. F.700 contains the umbrella
definitions

• Several MM tasks
• Conferencing (multipoint, bi-directional,
  real-time)
• Conversation (point-to-point, bi-directional,
  real-time)
• Distribution (point-to-multipoint,
  unidirectional)
• Sending (point-to-point distribution, Tx
  controlled, UD info pushing)
• Receiving (point-to-point distribution, Rx
  controlled, UD info retrieval)
• Collecting (multipoint-to-point distrib., UD, Rx
  controlled info polling)
• Media components audio, video, text, graphics,
  still-pictures, and data
• Quality level for media components -1, 0, 1, 2,
  3, 4

7
MM Service Descriptions (2)

• F.70x network-independent definitions
• F.702 (F.MCV)-Multimedia conference services
• F.703 (F.MCS)-MM conversational services

• Network-specific definitions
• F.731- N-ISDN MM conference services
• F.732- B-ISDN MM conference services

8
Terminals
9
Multimedia terminals
Integration of media components from the
equipment/protocol point-of-view

• H.320 Communications over N-ISDN
• H.310 Communications over B-ISDN
• H.323 Communications over packet networks
  (mainly IP)
• H.324 Communications using circuit-switched
  services (fixed and mobile, including
  3GPP)
• H.246 Terminal Interworking

10
Multimedia terminals (2)
Example Functional model for H.320 N-ISDN
Terminal
11
Multimedia terminals (3)
Example Functional model for H.323 Terminal
12
Multimedia terminals (4)
Example Functional model for H.324 Terminal
13
MM terminals (5) Interoperability
H.324
H.310
User data
User data
Audio/Video
Audio/Video
Fixed
Call Control (H.245)
Call Control (H.245)
Mux
H.223
H.222.0 H.222.1
Mobile
H.223 Anx.A-D
H.225.0
H.221
User data
RTP/ Non-QoS
Audio/Video
Audio/Video
QoS
Call Control (H.242/H.243)
User data
Call Control (H.245)
H.320
H.323
Scope for H.246
14
Media components
15
Data

• T.120-T.140,T.17x provide definitions for data
  exchange and control in MM conferencing
  applications. For example
• T.120 defines data protocols for multipoint
  multimedia conferencing (Annex C describes a
  light version of T.120). E.g. White-board
  applications.
• T.140 adds text conversation (chat e.g. for
  hearing-impaired people)
• T.17x MHEG for information retrieval

16
Media Coding

• Four aspects
• Audio
• Video
• Still-image
• Other media coding

17
Media Coding Audio

• Three classic quality tiers audio, wideband
  speech, and telephony speech.
• ITU-T focus on interactive communications, hence
  mainly produced wideband and telephony speech
  compression standards (F.700s A0 and A1 Quality
  Levels).

18
Media Coding A2/A3 Audio

• A2 coding for broadcast applications J.41
  (logarithmic PCM compression, 15kHz, 384kb/s)
  1988
• A2A3 Audio coding ISO MPEG
• MPEG2/Audio (e.g. MP3)
• MPEG4/Audio

19
Media Coding A1 Audio

• A1 Wideband speech coders (50-7000Hz)
• J.42 11-bit logarithmic PCM compression (192
  kbit/s) 1988
• G.722 Split-band ADPCM Coding of 7 kHz speech
  (64,5648 kbit/s) 1988
• G.722.1 Transform coding (3224 kbit/s) 1999
• G.16kWB Coding of 7 kHz speech at around 16
  kbit/s (planned mid 2001)

20
Media Coding A0 Audio

• A0 Telephony speech coders (300-3400 Hz)
• G.711 PCM coding (64 kbit/s) late 60s
• G.726 ADPCM coding (32 40, 24 16 kbit/s) 1988
• G.727 Embedded ADPCM coding (40-16 kbit/s) 1990
• G.728 LD-CELP coding (16 40, 11.8 9.6 kbit/s)
  1992
• G.723.1 Dual-rate coding (5.3 6.3 kbit/s) 1995
• G.729 CS-ACELP coding (8 12.8 6.4 kbit/s)
  1996-98
• G.4kbit/s Coding of speech at 4 kbit/s
• G.VBR Variable bitrate speech coding

Ongoing
New
21
Media Coding Video

• ITU standards
• H.261 ? Video Codec for N-ISDN
• H.262 MPEG2/Video (Common text)
• H.263 and Annexes ? IP, wireless, and N-ISDN
• H.26L successor to H.263

Ongoing
22
Media Coding Still Image

• Still image (B/W color) is used in facsimile
  services, in Internet applications, digital
  photography, etc.
• Standards work performed by a Collaborative
  ITUISO/IEC Team working under ISO/IEC SC29
  rules and organization
• ITU has common-text for JPEG/JBIG (T.80
  series) soon-to-be JPEG2000 (T.800 series)

23
Other media coding

• Currently not performed in ITU-T
• Character coding (ISO/IEC SC2 activity)
• Speech synthesis (text-to-speech)
• Speech recognition (new developments)

24
Conclusion

• Service definitions provide the user perspective
  for MM communication
• Terminals protocols integrate different media
  components for specific applications
• Interoperability adaptations are necessary
• Existing terminals are network-specific, however
  there is a trend towards more flexible
  specifications.

25
Media Coding Supplemental Slides
26
Telephony-band Speech Coding Families
27
Telephony-band Speech Coding Families
28
A2/A3 Non-ITU Standards

• MPEG2/Audio audio coding gt 64 kbit/s (1992)
• MPEG4/Audio audio speech coding at bit rates
  between 64 and 2 kbit/s (1998)

29
A0-A1 Non-ITU Standards

• ETSI/3GPP
• 13 kbit/s RPE-LTP (Full rate GSM, 1988)
• 6.5 kbit/s VSELP (Half-rate GSM, 1993)
• 12.2 kbit/s EFR (Enhanced full-rate GSM, 1996)
• 12.2 - 4.75 kbit/s AMR (Adaptive Multi Rate,
  1999)
• 6.6 - 23.85 kbit/s AMR-WB (Wideband AMR, 2001)
• ARIB (Japan)
• Full-rate PDC (Personal Digital Communication)
  6.7 kbit/s VSELP
• Half-rate PDC 3.45 kbit/s Pitch Synchronous
  Innovation CELP

30
A0-A1 Non-ITU Standards (contd)

• US TIA (ANSI)
• CDMA
• IS96 8,4,2 kbit/s QCELP (Qualcomm CELP, 1992)
• IS127 8.55, 4, 0.8 kbit/s EVRC (Enhanced Var.
  Rate Codec, 1996)
• IS733 13.3, 6.2, 2.7, 1 kbit/s VRC (Variable Rate
  Codec, 1998)
• CDMA2000 9.6,4,2.4,0.8 kbit/s SMV (Selec.Mode
  Vocoder, ?2002)
• TDMA
• IS54 7.95 kbit/s VSELP (Vector-Sum Excitation
  Lin.Pred., 1990)
• IS641 7.4 kbit/s ACELP (Algebraic CELP, 1997)
• PCS1800 (GSM upbanded to 1800 MHz)
• IS136-410 12.2 kbit/s US1 (1999)

31
Still Image Coding Summary (1)

• Umbrella T.80 1992
• JPEG T.81 (Part I), lossy and loss-less 1992
  T.83 (Compliance testing) 1994 T.85
  (Extensions, defs testing) 1996 T.85 Corr.1
  1999 T.86 Registration of JPEG Profiles
  1998 T.87 (Baseline) Lossless and
  near-lossless compression of continuous-tone
  still images 1998
• JBIG T.82, loss-less 1993 T.82 Corr.1 1995
  T.85 JBIG for fax terminals T.85 Amd.1 1996, 2
  1997 T.85 Corr.1 1997 T.88 Lossy/lossless
  coding of bi-level images 2000 T.89
  Application profiles for Recommendation T.88
  2000

32
Still Image Coding Summary (2)

• Planned new common texts
• T.800 Part 1, JPEG 2000 Image Coding System
  Core Coding System
• T.801 Part 2, JPEG 2000 Image Coding System
  Extensions
• T.802 Part 3, Motion JPEG 2000
• T.803 Part 4, Conformance Testing
• T.804 Part 5, Reference Software
• T.805 Part 6, Compound Image File Format
• T.806 Part 7, Technical Report Guideline of
  minimum support function of Part-1

33
ITU-T Video Coding

• H.261 Video Codec for A/V services at p x 64
  kbit/s
• The first practical video coding standard (1990)
• Used today in (ISDN) video conferencing systems
• Bit rates commonly 40 kbit/s to 2 Mbit/s
• H.262 Same as MPEG-2/Video (ISO/IEC 13818-2)
• Commonly used for entertainment-quality video
  applications
• The first practical standard for interlaced video
• Used in digital cable, digital broadcast,
  satellite, DVD, etc.
• Bit rates commonly 4-20 Mbit/s

34
ITU-T Video Coding(continued)

• H.263 Video Coding for Low Bit Rate
  Communication
• Significantly improved video coding compression
  performance (especially at very low rates, but
  also at higher rates as well)
• The first error and packet loss resilient video
  coding standard
• Used in Internet protocol, wireless, and ISDN
  video conferencing terminals (H.323, H.324, 3GPP,
  etc.)
• Baseline core mode interoperable with
  MPEG-4/Video
• Rich set of features for many applications
• Very wide range of bit rates and possible
  applications

35
Non-ITU-T Video Coding

• MPEG-1/Video (ISO/IEC 11172-2)
• The first video coding standard using half-pel
  motion compensation
• Typical bit rates 1-2 Mbits/s
• MPEG-4/Visual (ISO/IEC 14496-2)
• The first video coding standard defining
  arbitrary object shapes
• Many creative features for synthetic and
  synthetic-natural hybrid content
• Contains essentially all features of all prior
  standard codec designs
• Interoperable with ITU-T H.263 baseline
• Very wide range of bit rates and possible
  applications