Implementation of Microsoft HD Photo Codec

1
Implementation of Microsoft HD Photo Codec (JPEG
XR) on Nokias Series 60 Platform
2008 Nokia University Relations Forum June 12,
2008 Derek Pang, Dr. Jie Liang

• Simon Fraser University
• School of Engineering Science

2
Outline

• Introduction
• What is HD Photo?
• Why HD Photo?
• HD Photo on Nokia Phones
• Summary

3
Introduction

• This project is about the comparison of different
  image compression standards
• Digital images are ubiquitous
• Internet
• Digital cameras
• Cell phones
• Image compression is necessary for the storage
  and transmission of images
• JPEG is the most popular standard for image
  compression
• Started in 1986, finalized in 1992.

4
JPEG

• Key features of JPEG
• 8x8-block Discrete Cosine Transform (DCT)
• Huffman coding
• Pros
• Low complexity
• Hardware friendly
• Cons
• Unsatisfactory compression efficiency
• Blocking artifact at low bit rates

5
JPEG2000

• Designed to address the issues of the JPEG
• Finalized in 2000
• Key features
• Wavelet transform
• Adaptive arithmetic coding
• Pros
• Improved efficiency
• Various scalabilities
• Cons
• Much higher complexity (3-4 times)
• http//www.jpeg.org/public/wg1n1816.pdf
• Current status
• Limited industrial adoption, especially in
  hardware

http//en.wikipedia.org/wiki/JPEG_2000
6
HD Photo

• The latest image codec developed by
• Microsoft's Windows Media Group
• Originally known as Windows Media Photo
• Used by Windows Vista
• Photo Gallery, thumbnail preview,
• Based on Lapped Transform instead of DCT or
  wavelet
• Similar performance to JPEG 2000, but with much
  lower complexity
• An attractive alternative to JPEG 2000,
  especially for hardware
• Expected to become an international standard,
  JPEG-XR,
• by 2009

7
Lapped Transform

• The original lapped transform
• Developed by Malvar et al. in around 1985
• DCT with post-processing
• Time domain lapped transform
• Developed by Tran, Liang and Tu in 2001.
• DCT with pre-processing
• More flexible than the original lapped transform
• Adopted in HD Photo
• Lapped transform vs. Wavelet
• Similar coding performance
• Lapped transform has lower complexity

8
Our Project

• The original goals of this project
• To implement HD Photo on Nokia platform, in
  particular, the N82 phone
• To compare the complexities and performances of
  HD Photo and JPEG on Nokia phones
• Thanks to Dereks hard work, we have been able to
  implement the JPEG 2000 on the Nokia platform as
  well
• This allows a fair comparison between
• HD Photo and JPEG 2000.

9
Outline

• Introduction
• What is HD Photo?
• Why HD Photo?
• HD Photo on Nokia Phones
• (by Derek)
• Summary

10
Reference Codec

• HD Photo
• HD Photo Device Porting Kit 1.0 from Microsoft
• Not Optimized for Symbian platform
• Written in C
• JPEG 2000
• OpenJPEG 1.3 from http//www.openjpeg.org
• A more appropriate benchmark to compare the
• performance with HD Photo Codec
• Written in C

11
What we have implemented ?

• Environment
• S60 3rd Edition Feature Pack 2, Nokia N82
• Thanks to Nokia Open C initiative
• With modifications, we managed to port both codec
  to Nokia Series 60 Platform
• Intermixing Open C with Symbian C, a simple GUI
  application is written
• to demonstrate the encoding and decoding of JPEG
  XR
• to measure and compare the performance against
  JPEG and JPEG2000

12
Screenshots
13
Result Quality Comparison

• 640x480 image, encoded at the same compression
  rate (3) with a compressed file size of 27kB.

JPEG, PSNR 32.8dB
JPEGXR, PSNR 36.4dB
J2K, PSNR 35.4dB
14
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 14
Presented by Derek Pang
Result Compression Comparison

• 640x480 image, encoded at same quality.

JPEG File Size
JPEG XR / JPEG2000 File size
40 smaller compared to JPEG!!
15
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 15
Presented by Derek Pang
Result Quality Comparison
16
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 16
Presented by Derek Pang
Result Performance Comparison
17
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 17
Presented by Derek Pang
Result Performance Comparison
18
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 18
Presented by Jie Liang
Outline

• Introduction
• What is HD Photo?
• Why HD Photo?
• HD Photo on Nokia Phones
• Summary

19
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 19
Presented by Derek Pang
Summary

• We have implemented HD Photo and JPEG 2000 on
  Nokia phones
• We have verified the advantages of JPEG XR
• Better compression efficiency than JPEG
• Faster encoding/decoding than J2K
• Possible future work
• Integration with Camera and Multimedia API
• Demonstration of progressive scaling and regional
  decoding
• Optimization of the codec

20
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 20
Presented by Derek Pang
ADDITIONAL SLIDES
21
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 21
Presented by Derek Pang
Settings UI
22
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 22
Presented by Derek Pang
Result JPEG XR vs JPEG
23
Implementation of Microsoft HD Photo Codec on
Nokias Series 60 Platform
Slide 23
Presented by Derek Pang
Result JPEG XR vs. JPEG