Facial Expression Analysis CVPR07

1
Facial Expression Analysis (CVPR0708)
Facial Expression 1.

• Static Image based Methods
• Video based Methods
• A nature facial expression evolves over time
• from the onset, the apex, to the offset.
• The key issue is how to describe the
• dynamics of the expression?

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
2
Facial Expression 2.
Facial Expression Analysis (CVPR 08)

• Video based Methods
• The time-resolution issue

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
3
Facial Expression 3.
Facial Expression Analysis (CVPR 08)

• Our Solution
• Harr-like feature representation
• Gaussian based temporal pattern
• models

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
4
Facial Expression 4.
Facial Expression Analysis (CVPR 08)

• Our Solution
• Dynamic binary patterns
• Adaboost based classifier

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
5
Facial Expression 5.
Facial Expression Analysis (CVPR 08)
National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
6
Facial Expression 6.
Facial Expression Analysis (CVPR 08)
National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
7
Face Alignment (ICCV07)
Face Alignment 1.

• Active Shape Model (ASM)

• The original ASM
• PCA based global shape model
• Local texture models for every shape point
• The issues
• Points are independent in search
• Global shape model is linear

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
8
Face Alignment 2.
Face Alignment (ICCV07)

• Component based Framework
• Local model PCA Nearest neighborhood
  constrain between points
• Global model GPLVM

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
9
Face Alignment 3.
Face Alignment (ICCV07)

• Objective Function

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
10
Face Alignment 4.
Face Alignment (ICCV07)

• MRF based Local Search

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
11
Face Alignment 5.
Face Alignment (ICCV07)

• GPLVM based Global Constrain

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
12
Face Alignment 6.
Face Alignment (ICCV07)

• GPLVM vs. PCA as Global Model?

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
13
Face Alignment 7.
Face Alignment (ICCV07)

• Alignment Results with Occlusion

ASM
PCMN
Our method
National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
14
Face Alignment 8.
Face Alignment (ICCV07)

• Alignment Results with exaggerated expression
  and off-plane rotations

ASM
PCMN
Our method
National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
15
Face Alignment 9.
Face Alignment (ICCV07)
National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????
16
Face Alignment 10.
Face Alignment (ICCV07)

• Illumination Robustness Evaluation

National Laboratory of Pattern
Recognition Institute of Automation, Chinese
Academy of Sciences
??????????? ???????????