Smartphone Design With TI OMAP2420

1
Smartphone Design With TI OMAP2420
Scott McMichael Yu-Hong YenJames Walker
2
Marketing Research

• 664.5 Million cell phones were sold in 2004 alone
• Sales of camera phones rose more than 200 in
  2004
• In Western Europe camera phones make up almost
  75 of all mobile phones being sold
• More camera phones are being sold than actual
  cameras
• Current US market penetration of camera phones is
  14
• Still plenty of customers for new products

3
The Competition
Nokia 7610 - 500

• Features
• voice commands
• 1 megapixel camera
• 176x208 display, 65k colors
• Bluetooth
• 8mb built-in flash memory
• memory card support
• mp3 player
• 3 hours active battery life

4
The Competition
Motorola Razr V3 - 450

• Features
• voice commands
• .3 megapixel camera
• 176x220 display, 260k colors
• second front display 96x80 pixels, 4k colors
• 5mb built-in flash memory
• Bluetooth
• very small profile
• 4 hours active battery life

5
The Competition
Siemens S65 - 430

• Features
• 1.3 megapixel camera
• 176x132 display, 65k colors
• 32mb built-in flash memory
• Bluetooth
• 4 hours active battery life
• Expansive set of business features

6
Smartphone Plan

• Allow interactive video chat
• Support popular features
• Voice commands
• Utility programs and games
• Customizable screens and ringtones
• Good battery life
• Large amount of storage
• Small size
• Stylish layout
• Support variety of accessories (sold separately)

7
Design Specifications

• Smartphone will be built around TIs powerful
  OMAP 2420 system.
• When possible, other components from TI will be
  used.
• Symbian OS will be used to control the phone.
• Key feature is use of new H.264 compression
• Moderate screen size to allow for compact phone
• Avoid PDA-style appearance
• WiFi, Bluetooth, and 3G connectivity

8
Hardware Overview
9
Hardware Description - OMAP 2420

• Powerful integrated solution
• Contains ARM1136 processor, TI TMS320C55xDSP,
  2D/3D graphics accelerator, and imaging/video
  accelerator
• Capable of performing real-time 640x480 H.264
  compression at 30 FPS
• Capable of running demanding applications and
  games
• Variety of design tools available

10
Hardware Description - OMAP 2420
ARM1136 Processor

• 8 Stage pipeline
• Direct execution of Java bytecodes
• 32 bit and 16 bit instruction sets

TI TMS320C55xDSP

• Four 40 bit accumulators
• Variable length instructions (8 48 bits)
• Twelve independent busses

11
Hardware Description - Visual
Display - Epson Sanyo L2D22000T

• 176 x 220 Resolution
• Can display 260k of colors

Camera - IC Media ICM130E

• 1.3 Megapixel resolution
• Operates at 30 FPS

12
Hardware Description - Wireless
WLAN TI TNETW1230

• 802.11a/b/g connectivity

Bluetooth - TI BRF6150

• Allows communication with Bluetooth enabled
  devices.
• Does not conflict with WiFi connection

3G Chipset TI TCS4105

• Dual-mode GSM/GPRS and WCDMA
• 3G can provide data rates over 144 kBits/sec

All share the same antenna
13
Hardware Description - Memory
Spansion MCP - S71GS256

• 256 mb Flash
• 64 mb psRAM
• 16 bit bus
• 110ns access time
• 30ns page time

Memory Requirements

• Ram
• Symbian OS 8mb
• Video handling 8mb
• other programs much more
• Flash
• Video recording As much as possible

14
Hardware Description - Price

• Component Estimated Price ()
• Main Processor (OMAP2420) 70.00
• LCD Display 70.00
• Camera Sensor 10.00
• Memory 20.00
• Wireless Modules (3) 20.00
• Battery 10.00
• Other (Antenna, packaging, etc) 50.00
• Total Estimate 250.00

System should fall in 400-500 price range
15
Hardware Description Battery Life

• Component Active Power Consumption (mA)
• Main Processor (OMAP2420) 500
• LCD Display 60
• Camera Sensor 90
• Memory 50
• Wireless Hardware 100
• All Other 50
• Total Estimate 850.00
• Typical battery capacity 1400mA/h ? 1.5 hours
  at maximum usage
• It is unlikely that all components will ever be
  consuming maximum power 500 mA is a more
  accurate consumption estimate.
• ? 3 hours active battery life

16
Audio G.723.1

• Sound sampled with 16 bits
• Sampling rate of 8kHz
• 128 kbit/second input data collection rate
• 6.3 kbit/second output data rate
• 8 kbytes of memory need to execute algorithm

G.711 sample (64 kbit/second)
G.723.1 sample (6.3 kbit/second)
17
Video Chat Bandwidth Usage

• 18 bit color at 30 FPS ? 540 bits/(pixelsecond)
• Using full display 176x220 pixels ? 20.9
  Mbits/second
• H.264 compression can achieve 2001 compression
• 20.9 ? real time H.264 compression ? .1
  Mbits/second
• 100 kbits/second
• G.723.1 uses 6.3 kbits/second
• Total usage is 106.3 kbits/second
• 3G bandwith is 144 kbits/second

Full screen video chat is possible with 3G or
equivalent connection speed
18
Video Chat Standard Formats

• QCIF 144x176 pixels
• Requires 80 kbits/second
• SQCIF 128x96 pixels
• Requires 40 kbits/second

19
Overview of H.264

• Introduction
• Encoder and Decoder
• Advantages of H.264
• Comparison with other standards
• Video demo

20
Introduction

• In 1995, the ITU-T Video Coding Experts Group
  (VCEG) started working on the draft of H.264.
• In 2001, the ISO Motion Picture Experts Group
  (MPEG) and VCEG formed the Joint Video Team (JVT)
  to develop H.264 into a full International
  Standard.
• In 2003, H.264 is finalized and is approved by
  the ITU-T.

21
History of Video Compression Standard
22
Encoder
Fn (current)
Macroblock
23
Encoder( forward path)

• An input frame Fn is processed into several
  macroblocks ( 16x16 pixels ) .
• Each macroblock is encoded in intra or inter mode
  to form a prediction macroblock P.
• The current frame is transformed and Quantized
  with prediction P to produce a set of quantized
  transform coefficients.
• The coefficients are entropy encoded and passed
  to a Network Abstraction Layer( NAL) to transmit
  or store.

24
Encoder( reconstruction path)

• The quantized macroblock coefficients are
  re-scaled and inverse transformed to produce Dn.
• The prediction macroblock P is added to Dn to
  create a reconstructed macroblock uFn for
  encoding of further macroblocks.

25
Inter Prediction

• In Inter mode, prediction frame P is formed by
  motion-compensated (MC) prediction from one or
  more reference frames.

26
Intra Prediction

• In intra mode, frame P is formed from samples in
  current frame Fn that have previously encoded,
  decoded and reconstructed.

Intra 4x4
Intra 16x16
27
Examples of Intra Prediction
Original image
Vertical
Horizontal
Main Diagonal
28
NAL

• Network Abstraction Layer is designed to provide
  a friendly network. Each syntax structure in
  H.264 is placed into a logical data packet called
  a NAL unit. Rather than prior standards, the NAL
  unit offers greater customization of carrying the
  video content in a manner appropriate for each
  specific network.

29
Decoder
30
Decoder

• The decoder receives a compressed bitstream from
  the NAL.
• The bitstream is entropy decoded to generate the
  quantized coefficients.
• The decoder creates a prediction macroblock P by
  using the header information from the bitstream.
• The quantized coefficients and the prediction P
  are added together to create the decoded
  macroblock Fn.

31
Advantages

• Up to 50 in bit rate savings when comparing with
  H.263
• High quality video
• Network friendliness

32
Compare to Mpeg-2, H.263, Mpeg4
H.264 MPEG4 H.263 MPEG2
Source T. Weigand and G. J. Sullivan The h.264
MPEG-4 AVC Video Coding Standard
33
PSNR

• PSNR Peak SigNal-to-Reconstructed image measures
  are estimates of the quality of a reconstructed
  image compared with an original. In general, the
  higher the PSNR, the better quality of the
  reconstructed image.
• The definition of PSNR is as following

34
Example 1
35
Example 2
36
Example 3
37
Example 4
38
Video Demo
39
Software Architecture and Tools

• Software Development Platforms
• Operating System
• System Model
• Design Process

40
TI OMAP2420 Software Development Platform
41
(No Transcript)
42
Virtio Hardware EmulatorVPOM-2420 Virtual
Platform

• High performance software emulator of the TI
  OMAP2420
• Software Development Platform (SDP)
• Provides low-level execution control and
  visibility into the CPU and the peripheral
  components
• Allows camera application development through a
  USB camera or from a video file
• Allows control of the power management hardware
  and provides insights into the interaction of the
  hardware with OS power management services
• Configurations available for multiple OS
• We can verify our software without hardware
  debugging!

43
Operating System

• Our choice Symbian OS Series 60 v7.0s
• A robust multi-tasking OS, designed specifically
  for
• wireless environments and constraints of mobile
  phones.
• Features
• Customizable user interface
• Application engines for the core mobile phone
  applications contacts, calendar, messaging and
  device synchronization
• Fully integrated communications and messaging,
  support of telephony and networking protocols
• Provides a lightweight, multi-threaded framework
  for handling multimedia data and audio / video
  recording, playback, and streaming functionality.
• Open development platform for third-party
  developers.

44
Symbian Series 60 SDK Emulator

• Useful for developing, testing, and profiling
  Symbian applications
• Emulates Bluetooth and WLAN through normal ISP
  connections
• Emulates camera input
• Here is a simple demonstration!

45
System Model
46
Video Calling Level 1
47
Video Calling - Level 2
48
Receive Audio/Video Message
49
Design Process
50
System Development Cost

• Component Estimated Price ()
• Salaries for four months 500,000
• Development tools 50,000
• Artistic Design 5,000
• Testing 150,000
• Total Estimate 705,000

51
Estimated Profit
Estimated sales x Profit per sale
100,000 x 200 Estimated development cost
705,000 Software Licensing
1 million Net profit
18 million
52
Thanks!

• Questions???