Wyner-Ziv Video Coding with Hash-Based Motion Compensation at the Receiver

1
Wyner-Ziv Video Coding with Hash-Based Motion
Compensation at the Receiver
2
Overview

• Low-complexity video encoding
• Wyner-Ziv video codec
• Hash-based motion-compensation at the receiver
• Simulation results

3
Interframe Video Coding
PredictiveInterframe Encoder
PredictiveInterframe Decoder
X
X
Side Information
4
Video Coding with Low Complexity
X
X
5
Wyner-Ziv Coding
Wyner and Ziv, 1976
Lossy compression with decoder side information
6
Wyner-Ziv DCT Video Codec
W
W
Interframe Decoder
Intraframe Encoder
IDCT
IDCT
IDCT
Xk
Xk
qk
qk
Reconstruction

Request bits
bit-plane Mk
Side information
Yk
For each transform band k
DCT
Aaron, Rane, Setton, Girod, VCIP 2004
Y
Interpolation/ Extrapolation
Conventional Intraframe decoding
Conventional Intraframe coding
K
K
7
Hash-Based Motion Compensation at the Receiver
Decoded WZ frames
WZ frame
WZ parity bits
Wyner-Ziv Encoder
Wyner-Ziv Decoder
W
W
Side information
Y
Interpolation/ Extrapolation
Decoded frame/s
I-P-P-P structure
8
Hash-Based Motion Compensation at the Receiver
Hash quantized subset of DCT coefficients
4x4 DCT
Encoder Hash of block may not be sent depending
on hash of co-located previous block. Need hash
storage. Decoder Hash used for motion estimation
(block-matching).

• Hash used at turbo decoder as systematic bits
• Can potentially be used to estimate rate at
  encoder

9
Compression Results - Salesman

• Side information generated using previous frame
  and hash
• Salesman QCIF sequence at 10fps

10
Compression Results Hall Monitor

• Side information generated using previous frame
  and hash
• Hall Monitor QCIF sequence at 10fps

11
Salesman sequence at 10 fps
DCT-based Intracoding 247 kbps PSNRY33.0 dB
Wyner-Ziv DCT codec 256 kbps PSNRY39.1 dB
GOP16
12
Salesman sequence at 10 fps
H.263 I-P-P-P 249 kbps PSNRY43.4 dB
GOP16
Wyner-Ziv DCT codec 256 kbps PSNRY39.1 dB
GOP16
13
Hall Monitor sequence at 10 fps
DCT-based Intracoding 231 kbps PSNRY33.3 dB
Wyner-Ziv DCT codec 227 kbps PSNRY39.1 dB
GOP16
14
Hall Monitor sequence at 10 fps
H.263 I-P-P-P 212 kbps PSNRY43.0 dB
GOP16
Wyner-Ziv DCT codec 227 kbps PSNRY39.1 dB
GOP16
15
Summary

• Wyner-Ziv video codec with hash-based motion
  compensation at the receiver to generate better
  side information
• Similar encoding complexity as DCT-based
  intracoding
• Compression performance
• Up to 8 dB better than DCT-based intracoding of
  frames
• Performance gap from H.263 I-P-P coding