Virtual Presentation and its Application for Museum and Digital Heritage

1
Virtual Presentation and its Application for
Museum and Digital Heritage
Zhi-geng Pan State Key Lab of CADCG, Zhejiang
University, China
2
About

• About my university Zhejiang University
• About the Lab
• State Key Lab of CADCG
• zgpan_at_cad.zju.edu.cn

3
Outline

• Introduction
• Related Works
• Our Experiences and Showcases
• Implementation of EasyMall
• Image-based Virtual Presentation for Textile
  Products
• Integrating Virtual Human into Product
  Presentation
• Applications to museum, virtual touring, digital
  heritage
• Conclusion

4
1.Introduction

• Virtual Reality and Virtual Presentation
• Virtual Reality
• Virtual Presentation
• Show the property (size, color, et al.)
  function, structure of the product
• Change the viewpoint of the users
• Show the products with different color and
  texture without changing the shape and dimension.
  
• (3) Application of Virtual Presentation

5
2.Related Works

• Applying VR to products presentation
• VR and Interactive Virtual Experience
• Integrating E-commerce with VR
• VR-based product presentation for Virtual
  Kitchen, Japan
• In 1994, CIA-Tool
• "Virtual Car" Simulator, Germany
• Virtual Design Exhibition.

6
2.1 Snapshots of Several 3D VSM(1/5)

• A prototype system
• Allows users to choose their own figures from
  several simple avatars during navigation

(a) Marcus Kaars VSM, German
7
2.1 Snapshots of Several 3D VSM(2/5)

• Based on Blaxxun VRML multi-user technology
• Support parallel negotiations
• Raise user acceptance by using 3D graphical
  representations of the participants.

(b) VR-Shop http//www.vr-shop.iao.fhg.de
8
2.1 Snapshots of Several 3D VSM(3/5)

• Provides toolkits to build interactive virtual
  community
• _at_mart in Active Worlds is an exemplary world
  which shows how the toolkit can be used to build
  a 3D virtual shopping mall.

(c) Active Worlds http//www.activeworlds.com
9
2.1 Snapshots of Several 3D VSM(4/5)

• An Agent-aided Collaborative Virtual Environment

• Bridges the gap between the Industrial Training
  and E-commerce
• Provides the user with a much enjoyable
  experience while shopping online.

• (d) MCRLabs CVE, Canada
• http//www.mcrlab.uottawa.ca

10
2.1 Snapshots of Several 3D VSM(5/5)

• Provides toolkits to build interactive virtual
  community
• The main goal of this project is to design and
  implement a scalable network framework for large
  distributed virtual environments.

(e) CDSN Labs VSM, Korea http//cds.icu.ac.kr/ea
i/VSMclient.html
11
2.1 Snapshots of Several 3D VSM

• PhoneShow (VR Lab, POSTECH, Korea)

• Control Cally to show several behaviors of
  operating phone through blending some fixed
  motions
• Feel and image what it would be like during his
  own operation.

Showing with third port view
12
2.1 Snapshots of Several 3D VSM

• manipulates the phone with his own hand

• operates phone, pay a close seeing /far seeing
  through zooming in/out,
• power on /power off
• open / fold the upper body of the mobile phone

Showing with first port view

13
2.2 Other Applications

• Cybertown Shopping Mall at www.cybertown.com
• Eluxury online shopping site at www.eluxury.com
• FAO schwarz virtual playroom at www.fao.com.

14
2.3 Comparation of the product presentation
methods (1/2)

• Two kinds of presentation methods 2D image based
  3D model based
• Advantages of 3D model based method
• gives users an innovative experience of the
  product
• offers users varying degrees of viewing, but a
  standard 2D image can only appeal to the visual
  sense
• enables consumers to interact with products on
  the Internet rather than just look at them.

15
2.3 Comparation of the product presentation
methods (2/2)

• Disadvantages of 3D model based method
• With the current limited transmission bandwidth,
  building VE for the Internet always means to
  reduce geometry and the number of elements shown
  
• The sense of immersion is deduced because of
  using 2D devices, the screen and mouse, but not
  head-gear 3D devices
• The purchasing time under 3D presentation
  environment is longer than that under the
  traditional 2D presentation environment
• It is difficult to control a 3D space with the 2D
  interaction techniques
• The software needed for 3D is usually requires an
  extra download.

16
3. Our Experiences and Showcases

• 3D model-based Virtual Shopping Mall EasyMall
• Image-based Virtual Presentation for Textile
  ProductsEasyShow
• Application of VR/Virtual Presentation to museum,
  digital heritage See Section 4

17
3.1 EasyMall A Virtual Shopping Mall
18
1) Architecture of EasyMall
19
2) The interface of EasyMall

Avatar guiding customer enter EasyMall
A group of recommended T-shirts
20
3) Experimental Results

• 3D model based virtual Presentation and
  customization for furniture (1/2)

(a) Original scene
(b) After texture changed
21
3) Experimental Results

• 3D model based virtual Presentation and
  customization for furniture(2/2)

(d) Navigate in the room
(c) Interact with scene (ex. table is deleted)
22
3.2 EasyShow A Virtual Presentation System
for Textile Products
23
1) The characteristic of EasyShow system

• Simply Input
• Fast Processing
• Easy Operation (Friendly UI)

24
(1) Simply Input

• Only One ordinary photo is needed.
• The limitation of input several photos is
• How to get the these photos of one product?
• Are these photos necessary for the system?

(2) Fast Processing

• Texture morphing, color mixture and 3D
• simulation within several seconds.

25
(3) Easy Operation

• Drag and click
• Texture morphing
• with navigating
• interaction

26
2) Virtual Product Presentation

• About the input photo
• About the texture image
• 3D simulation
• Color mixture

27
(1) About the input photo

• Border partition Snake technique

28
(2) About the texture image

• Simple texture morphing
• Texture Area-based texture morphing
• Navigating interaction

29
(3) 3D simulation

• Flexible simulation
• 3D depth simulation

30
(3) 3D simulation

• Light-based texture dithering

31
(4) Color Mixture

• Lighting parameter extraction
• Color mixture based on color psychology

32
3) A New Texture Morphing Algorithm

• Texture morphing
• Smoothing operation

After texture morphing
The original image
Texture connecting
Texture smoothing
depth of field
33
A) Texture morphing

• U (V) texture vector
• connected texture region

34
A) Texture morphing

• Calculate texture coordinates

35
B) Smoothing operation

• smoothing polygons
• There are four cases when constructing smoothing
  polygons

36
B) Smoothing operation

• Adjust new texture coordinate as
• xx?I
• yy?I
• where

37
B) Smoothing operation
38
4)Experimental results

• Product matching
• Color matching
• Texture matching
• Style matching

39
4)Experimental results

• Checking the simulating of garment with different
  texture and different material

(d) Navigate in the room
40
4)Experimental results

• Checking the showing effect with different
  texture, different material, etc.

Screenshot for customizing bed clothing with
EasyShow
41
4)Experimental results
42
4)Experimental results
43
4 Applications to museum, virtual touring,
digital heritage

• CONTENT
• 4.1 Introduction to Digital Heritage
• 4.2 Key techniques
• 4.3 Examples

44
4.1 Introduction to Digital Heritage(1) World
Culture/Nature Heritages

• Many World Culture/Nature Heritages

????(???)
Hwaseong ??(?)
???(??)
???(?)
??
45
(2) The background of Digital Heritage

• Traditional method photo, video by cameras
• Difficult to store,retrieval
• No interactivity
• Digital method
• 1990s Multimedia, VR, 3D digitalized
  devices
• techniques? Digital Heritage
• No interactivity
• Presentation on the Internet

46
4.2 Key Techniques

• Image-based rendering
• (2) Panorama
• (3) Virtual Touring

47
4.3 Demos

• Demo for Grand Canal Museum
• Virtual Design for Theme park
• Virtual Presentation of Ancient town
• Virtual tour for Ancient Drug Store
• Virtual Design of Science Museum
• Animation for an ancient Chinese story
• Animation for our city

48
Examples
49
Conclusion

• Employ the mixed presentation method 2D image
  based 3D model based
• Showcases EasyMall and EasyShow
• Bright future of VR/virtual presentation for
  digital heritage, museum.

50
Show the Demo System if there is time available
Thank you!