Atmel Corporation

1
Atmel Corporation

• 2002 Sales Conference

AT76C11x MPIX DIGITIAL IMAGING PRODUCTS
The Marketing Team of MMC
2
AT76C11x MPIX DIGITAL IMAGING PRODUCTS
3
MPIX APPLICATIONS

• It takes still pictures
• It displays video
• It records/plays back voice memos
• It allows for multi-generation products to be
  developed with it.
• It is simply the Most Integrated Camera Engine in
  the Market today

Flash Card
4
OTHER APPLICATIONS

• Surveillance and Security
• Projectors

SDRAM
MPIX
phone line, wireless/wire-line Network
modem
Remote Site
Projector
USB
VGA Converter
MPIX
Flash Card reader
SDRAM
SDRAM
5
OTHER APPLICATIONS

• Flat-panel display devices
• TV Projection devices
• Mobile Terminals

Handheld projector
VGA Converter
Flash Card reader
MPIX
Flat panel
SDRAM
SDRAM
Mobile Terminal Add-on Module
Mobile Terminal controller
CMOS Imager
Flash Card reader (optional)
MPIX
SDRAM
6
MPIX-BASED DIGITAL CAMERAS
Temporary Storage for captured images
Image Capture
Capture Engine
Image Processing Engine
Display Engine
MPIX
Compression Engine
ARM7
Peripherals
Analog
Storage of processed and compressed images
Program code for ARM and Image processing engine
7
MPIX-BASED PROJECTORS
Temporary Storage for captured images
Buffer for frame-rate conversion
SSFDC MMC, SD DataFlash Compact Flash Slots
VGA Output
Capture Engine
Image Processing Engine
Display Engine
MPIX
Compression Engine
PC
USB
ARM7
Peripherals
Analog
SXVA/VGA Controller
Program code for ARM and Image processing engine
8
MPIX-BASED FLASH-CARD READERS FOR HDTV/TV LCD
PROJECTORS
Temporary Storage for captured images
Buffer for frame-rate conversion
VGA Output
HDTV or Flat-panel
Capture Engine
Image Processing Engine
Display Engine
SSFDC MMC, SD DataFlash Compact Flash Slots
FLASH CARD I/F
Decompression Engine
MPIX
ARM7
Peripherals
Analog
SXVA/VGA Controller
Program code for ARM and Image processing engine
9
OVERVIEW
The AT76C110 is a low-power integrated solution
for digital cameras. It combines a number of
functions that are required in implementing
digital cameras.

• Provides a large number of interfaces that allow
  camera manufacturers to directly access a variety
  of devices present in digital cameras
• Based on an ARM processor that controls the
  entire chip
• A number of hardware resources, controlled by
  ARM, perform functions such as
• Image processing
• JPEG coding/decoding
• Video encoding
• FLASH card, PC, SDRAM R/W

10
MPIX

• digital inputs
• control
• push buttons

SDRAM I/F
DAC with L.D.
TV
Imager
LCD
MPIX AT76C110

• Iris Control
• Shutter Motor
• Lens Motor
• FLASH Bulb Control
• AGC Gain
• Voice Output

CDS A/D
RS232 Port (PC)

• Battery Level Check
• Photo Detection (AE)
• Focus Sensor
• Voice Input

USB (PC)
Small Segment LCD
FLASH Card I/F
External Memory I/F

• FLASH
• CF

• MMC/SPI, SD
• SSFDC
• Data FLASH

11
FEATURES

• Supports both CCD and CMOS-type Imagers
• Supports up to 16 megapixel Imager
• Supports progressive and interlaced (2 and 4
  field) Imagers
• Interface to 16-256 Mbit SDRAM
• Up to 2 Mbytes program Flash
• 30 frames/sec video mode
• 15 frames/sec capture mode (VGA resolution)
• 2 Mbytes/sec read/write from/to FLASH cards (MMC,
  SD, DataFlash, SSFDC, Compact Flash)
• Full-speed USB interface (mass storage, and image
  class)
• FLASH upgradable using USBs DFU function
• 280-pin FlexBGA package
• 3.3V Core and I/O

12
HARDWARE FEATURES

• Hardware functions for Imager processing
• Video Encoder
• Baseline JPEG compression/decompression
• SDRAM interface
• Interfaces for all FLASH card standards
• Integrated DACs for LCD (incl. line driver for
  NTSC/PAL TV signal)
• USB interface and UART for PC camera applications
• Direct interface with UNIPAC and EPSON LCDs

13
HARDWARE FEATURES

• Small-Segment LCD driver (4-level, 27 SEG, 4 COM)
• 32 pins for General Purpose I/O
• 5 External interrupts, and Wake-up pin
• 4 DACs for camera control functions
• 4 ADCs for monitoring camera analog inputs
• Serial interface for controlling camera
  components
• Cache-memory and memory management unit for
  high-performance and low-power consumption

14
MA140 UD70 LD70 CS RAS CAS WE DQMU DQML C
KE SDCLK
AT76C110 ARCHITECTURE
IREF CVBS Y70 C70 VBLK HBLK FLD PXOE PCLKO I
REFL R G B
SDRAM Interface
AT76C110
Video Output
PD90 VD HD FI21 PXCLK
Pixel Interface
Display Interfaces
AE, AF, OB Evaluation Block
JPEG Codec
Image Processing
LCD Output
MRESET WKP LFT LFTU MCLK io UCLK io RTCLK
io TEST INT40 ECNT P170 P270
P370 P470
JPEG/SDRAM Interface
System
Serial Camera Interface
Interrupt Controller
SCS
register file
SCK TXD/SO RXD
Interrupt Timers
Serial Interfaces
USART
GPIO
ARM7TDMI (thumb mode)
Mem I/F
Paging
D D- USBP
12Kbyte (Prog/data) RAM
A310 D310
USB
DA30
DACs
AD30
Realtime Clock
ADCs
Analog Interfaces
DMA I/F
REG CE21 FOE FWE IORD RESET IOWR INPACT RDY/BSY
WAIT WP VSI CD21 BVD21
Flash-card Interfaces
VLC31 SEG260 COM30
SS-LCD Interface
BCH codec
MMC/SD (SPI)
Compact Flash
Data Flash
SSFDC
CCS FWR FRD FA190 FD150
TRST TCK TMS TDI TDO
FA/FD are also used for FLASH cards
Program FLASH
(ARM ICEbreaker)
15
MPIX OPERATION MODES

• Capture
• Display
• Movie
• JPEG compress
• JPEG decompress
• Image processing
• PC file transfer
• Flash Card file transfer

16
POWER MANAGEMENT

• Gated clocks to shut-off inactive modules
• All PLLs, OSCs, pads, can be individually turned
  off
• Various power management modes
• Full-speed 24MHz ARM
• Low-speed 3MHz ARM
• Sleep mode ARM is OFF only RTC is active
• Paging system to reduce I/O access

17
SDRAM CONFIGURATION
Capture window
Display window
Imager defect window (capture mode)
Movie window A
Processed window
Movie window B
Imager defect window (movie mode)
18
MPIX IMAGE PROCESSING
Y,C
EDGE ENCHANCEMENT
Y
Y
TV
IMAGER DEFECT CORRECTION
RGB to YC
Imager
GAMMA CORRECTION
COLOR RECOVERY
OPTICAL BLACK
DECIMATION
GAIN
C
HUE CORRECTION
Input
CHROMA GAIN
LCD
C
Rough gamma correction
Bright/ Shadow Accumulation
OB/OBV Accumulation
AWB AE
AF
Pixel Accumulation
19
ARM SUBSYSTEM

• Paging system for program data with DMA
• DMA between SRAM and SDRAM
• 16 Interrupts (programmable priority and end
  point)
• 3 timers with pre-scaler, programmable clocks
  (int./ext.)
• Audio codec function using DAC/ADC cells
• One ADC with four inputs (analog mux), 400 KHz,
  8-bits
• ADC can be configured in the following modes
• All channel continuous
• One channel continuous
• One-shot
• Four DAC, 100 KHz, 8-bits

20
JPEG CODEC

• Supports 422, 420 and 400 format
• Programmable window to be compressed
• Thumb nail compression/decompression
• Utilizes two quantization tables A, B for Y and
  UV
• Provides a quick assessment of compression
• Selects blocks based on of the pre-encoded
  patterns
• Performs compression on selected images
• Collects statistics on size

21
JPEG CODEC
ENCODING
TO ARM
FROM
HUFFMAN ENCODE
HOST I/F
DCT
QUANT.
SDRAM
TO SDRAM
Bit count for A
A
B
Bit control for B
QUANTIZATION TABLES
FROM
HUFFMAN DECODE
INV QUANT
HOST I/F
IDCT
TO SDRAM
ARM
ARM
NON-Standard HUFFMAN Codes
22
FLASH CARD INTERFACES

• Compact Flash
• Access using the ARM bus
• Burst mode 5.4 Mbytes/sec
• MMC, MMC/SPI, SD
• Hardware error detection/software error
  correction
• Burst mode1.5 Mbytes/sec (12 MHz clock)
• Atmel DataFlash
• Hardware SPI I/F
• Burst mode 1.5 Mbytes/sec (sustained)
• SSFDC
• Hardware support for error correction/detection
• Burst mode 1.8Mbytes/sec

23
SERIAL INTERFACES

• Full-speed USB bus (Image and mass storage
  class)
• Endpoint configuration
• 8-byte control
• 8-byte interrupt
• 960-byte ISO (double buffer)
• 64-byte Bulk in
• 64-byte Bulk out
• USART Interface
• 9.6, 19.2, 38.4, 57.6, and 115.2 Kbits/sec rates

24
ON-SCREEN DISPLAY

• Four variable-size different OSD windows
• Can be overlaid anywhere in the displayed image
• All OSD data is stored in SDRAM in 422 format
• One OSD window can be used as PIP movie window
• Supported PIP image sizes
• 320x240
• 214x160
• 160x120
• Data in the PIP window can be scaled by a factor
  of 2

25
SENSORS IN PRODUCTS

• 3.0M Sony ICX252
• 2.2M Sony ICX284/A
• 1.3M Sony ICX232
• 2.0M Fuji Film Microdevices MS3840
• 1.3M Panasonic MN39742
• 1.3M Motorola CMOS
• 1.3M Omnivision CMOS
• VGA Panasonic 27770BT
• VGA Hyndai CMOS HV7131B
• VGA ST Micro VV6500 CMOS

26
MPIX SOFTWARE STACK
Application Programs
Sensor Timing
AE/AF/AWB Examples
Imag. Proc. Algorithms
Graphics Libraries
USB Drivers MS/IC
Flash Card Filesystems
Imag. Proc. Libraries
Data Transfer Libraries
Hardware
Source code
Object code
27
SOFTWARE DELIVERABLES

• Object code of hardware-level drivers
• Object code of optimized libraries
• Source code of application layer
• Documentation of APIs
• Documentation of all libraries
• Users guide for development of applications

28
GRAPHICS

• Line drawing
• Filled rectangles
• Advanced color icon support
• Examples for tab control
• Menu example application
• Scalable fixed-width fonts
• Variable width font support
• Multi-language font support

29
FLASH CARD FILE SYSTEMS

• EXIF 2.1 support
• DCF 1.0 support
• DPOF Support
• DOS FAT file-system
• Smart Media interface library
• Compact Flash interface library
• MMC, SD interface library
• Multiple Flash-card support

30
USB DRIVERS

• Mass Storage for
• Win XP
• Win 2000
• Win ME
• Win 98
• UFI Control Bulk Interrupt Driver
• Image class USB drivers
• DFU program download

31
ADVANCED FEATURES

• Thumbnail support preview, and file management
  features
• Digital Zoom
• Multiple image resolution
• Video clips in Quicktime format
• Sound effects
• Dual-mode camera
• Flash light control

32
EVALUATION BOARD
6 x 4 inches
33
EVALUATION BOARD
Menu Switch
Push Button
4-way Switch
TV
USB
RS232
AT76C110
JTAG
Strobe
Audio
Front End
Compact Flash
34
EVALUATION BOARD
Back End
Power Board
Display Panel
35
STATUS

• Implementation is in 0.35µ
• Samples available now
• Development systems available now
• Reference design available now
• Production started on Q300

36
SUPPORT

• Datasheet and errata
• Software specification of low and middle level
  functions
• Low/middle-level software libraries (object
  code)
• Source code of application example
• Development board
• Users guide documentation of development board
• Direct engineering support from
• Atmel MMC, NC, USA
• Atmel HK, Hong-Kong
• Atmel Shanghai, China
• Several qualified design houses for ODM/OEM
  arrangements

37
ATMEL DSC PRODUCT DEVELOPMENT/SUPPORT CENTERS
Tokyo Support Center
Shanghai Design Support Center
Raleigh Main DSC Development Hardware Software
Taipei Support Center
Hong-Kong Support Center
38
MPIX Project Phase
I.
II.
III.
IV.
V.
Pilot Run, Mass Production
39
I. Customer Evaluation Phase
40
II. Preparation Phase
41
III. Initial Design Phase
From Preparation Phase
Customer Starts PCB Layout
Customer Starts Firmware and Performs Some System
Level Tests
Customer Develops PCB Assembly of Camera
42
IV. Product Development Phase
From Initial Design Phase
Atmel Shanghai Provides Customer with
Customer-Specific Applications and Support
Atmel MMC Provides Customer with
Customer-Specific Applications and Support
Customer Customizes Product According to System
Specification
Customer Integrates and Tests all Software
43
V. Design Approval Phase
44
AT76C110TARGET CUSTOMERS

• Sanyo
• Primax
• Premier
• Minton
• NuCam
• Largan
• API
• Inventec
• ViewQuest (DW)
• Welback (DW)

• IDT (DW)
• Wanzhong (DW)
• SAST (DW)
• Opcom (DW)
• DXG (DW)
• Farsharp (DW)
• Topping (DW)
• Panwest (DW)
• Kocom (DW)
• Imaging Devices

• Fuji Film (DW)
• Agfa
• Pretec
• Mustek
• Kodak
• Polaroid
• Alltek
• Samsung
• HP
• IBM

45
AT76C110 COMPETITORS

• Sharp
• LSI Logic
• Sound Vision
• Sierra Imaging (Conexant)
• TI
• ST Microelectronics

46
AT76C111

• Low-cost low-power of AT76C110
• Software compatible with AT76C110
• SD full support
• 32Kbytes internal RAM/Cache
• Stand-alone RTC power ring
• No SSLCD
• No RGB DACs
• 1.8V core and 3.3V I/O
• Samples NOW, EVM NOW, Production 2Q02

47
AT76C111 PACKAGE CONFIGURATIONS

• 280-pin BGA
• 280-pin AT76C111 and 1Mbyte Flash

48
AT76C111 EVALUATION BOARD
49
PRODUCT ROADMAP

• High-end DSC

• Mid-end DSC

• Low-end DSC

• Projectors
• TVs/Flat Panels
• Mobile Terminals

50
AT76C110

• MPIX-L (Low cost DSC, Flash-Card Playback
  device)
• Software compatible with AT76C110/111
• Memorystick support
• 1.8V core and 3.3V I/O, 208-pin BGA
• Samples 1Q02, Production 2Q02

51
MA140 UD70 LD70 CS RAS CAS WE DQMU DQML C
KE SDCLK
AT76C112 ARCHITECTURE
Video Out (playback applications)
SDRAM Interface
AT76C112
Video Output
Y70 C70 VBLK HBLK FLD PXOE PCLKO
Bidirectional YC Interface
JPEG Codec
Image Scaler
Video Input
MRESET WKP MCLK UCL TEST INT40 ECNT
P170 P270 P370 P470
JPEG/SDRAM Interface
Video In (CMOS Imagers)
System
Serial Camera Interface
Interrupt Controller
SCS
register file
SCK TXD/SO RXD
Interrupt Timers
Serial Interfaces
USART
GPIO
ARM7TDMI (thumb mode)
Mem I/F
Paging
D D- USBP
12Kbyte (Prog/data) RAM
A310 D310
USB
Realtime Clock
DMA I/F
REG CE21 FOE FWE IORD RESET IOWR INPACT RDY/BSY
WAIT WP VSI CD21 BVD21
Flash-card Interfaces
BCH codec
MMC/SD (SPI)
Compact Flash
Data Flash
SSFDC
MemoryStick
CCS FWR FRD FA190 FD150
TRST TCK TMS TDI TDO
FA/FD are also used for FLASH cards
Program FLASH
(ARM ICEbreaker)
52
AT76C111B

• MPIX-J (Low-End 2002 DSC product)
• Software compatible with AT76C110/111
• Host/Slave USB
• Support for unified memory architecture
• Audio Playback (MP3, WMA, AAC)
• Memorystick support
• Support for more LCDs
• RTC power ring with start-up capabilities
• RGB DACs Video DACs
• 1.8V core and 3.3V I/O, 208-pin BGA
• Samples 2Q02, Production 4Q02

53
AT76C113

• MPIX-M (2002 DSC product)
• Software compatible with AT76C110/111
• Host/Slave USB
• ARM9 CPU
• Support for unified memory architecture
• Audio Playback (MP3, WMA, AAC)
• MPEG4 Hardware codec
• Memorystick support
• Support for more LCDs
• RTC power ring with start-up capabilities
• RGB DACs Video DACs
• 1.8V core and 3.3V I/O, 256/208-pin BGA
• Samples 2Q02, Production 4Q02

54
AT76C114

• MPIX-H (High-end DSC Product)
• Higher processing power
• Improved statistics support for image processing
• Mini-Host USB
• DMA engines to transfer data to/from all
  peripherals
• 1.8V core, and 3.3V I/O
• In concept stage (Samples 4Q02)

55
MPIX ADVANTAGES

• It has been in high-volume production since July
  2000
• Design wins with major digital camera
  manufacturers
• The most highly integrated solution in the
  market
• Excellent image quality at low-price
• Low-power consumption
• Device passed vigorous reliability and
  qualification tests
• Commitment to supply complete system solutions
• Imagers (CMOS)
• Timing Generation Chips
• Digital Camera Processors
• Memory