Seam Carving for ContentAware Image Resizing

1
Seam Carving for Content-Aware Image Resizing

• Shai Avidan, Ariel Shamir
• SIGGRAPH 2007
• Kuang-Wei Fu
• Sep. 20th, 2007

2
Outline

• Introduction
• Background
• Operator
• Image Resizing
• Multi-size Images
• Result and Conclusions

3
Introduction

• Images typically remain rigid in size and cannot
  deform to fit layouts automatically
• Effective resizing of images should not only use
  geometric constraints, but consider the image
  content as well
• Scaling vs. Cropping vs. Seam carving

4
Introduction
5
IntroductionContributions

• Define seam carving and present its properties
• Present algorithm for image enlarging using seam
  insertions
• Use seams for content-aware image size
  manipulations
• Define multi-size images for continuous image
  retargeting

6
Outline

• Introduction
• Background
• Operator
• Image Resizing
• Multi-size Images
• Result and Conclusions

7
Background

• Cropping
• Face detectors
• Visual saliency map
• Foreground and background
• Seam
• Combine multiple images
• Texture synthesis

8
Outline

• Introduction
• Background
• Operator
• Image Resizing
• Multi-size Images
• Result and Conclusions

9
Operator

• Energy function
• Different strategies

10
OperatorSeam carving

• Seam
• Optimal seam
• Dynamic Programming

11
OperatorOther issue (1)

• Energy Preservation
• Different Energy Functions

12
OperatorOther issue (2)
13
Outline

• Introduction
• Background
• Operator
• Image Resizing
• Multi-size Images
• Result and Conclusions

14
Image ResizingAspect ratio change
Seam Scaling
Cropping
15
Image ResizingOptimal seams-order (1)

• Objective function
• Dynamic Programming

16
Image ResizingOptimal seams-order (2)
alternating optimal
vertical horizontal
17
Image ResizingImage enlarging
18
Image ResizingOther issue (1)

• Content Amplification
• Seam Carving in the gradient domain
• Object Removal

19
Image ResizingOther issue (2)
Gradient domain seam carving
Object removal
20
Outline

• Introduction
• Background
• Operator
• Image Resizing
• Multi-size Images
• Result and Conclusions

21
Multi-size Images

• Designer does not know at what resolution the
  image will be use
• User want to try different target sizes
• Seam carving is linear in the number of seams to
  be removed, or inserted.
• 400X500 -gt 100X100 will use 2.2 sec.
• Store the seam index maps

22
Multi-size Images

• Horizontal and vertical seams can collide in more
  than one place

23
Outline

• Introduction
• Background
• Operator
• Image Resizing
• Multi-size Images
• Result and Conclusions

24
Result and ConclusionsLimitation (1)

• Constraints Images
• Condensed Images
• Bypass important Images

25
Result and ConclusionsLimitation (1)
26
Result and ConclusionsConclusions

• Presented an operator for content-aware resizing
  of images using seam carving
• Operator can be used for a variety of image
  manipulations
• Operator can be easily integrated with various
  saliency measures
• Define a data structure for multi-size images
  that support continuous resizing in real time