The Intersection of Virtual Reality and Teleimmersion with

1
The Intersection of Virtual Reality and
Tele-immersion with

• REUNA Networking ConferenceValparaiso, Chile
  --- April 4, 2001
• Walter B. Panko, PhD Professor, Health
  Informatics

2
Virtual Reality The Future has Arrived

3-Dimensional Education Simulations Pre-Treatment
planning
CAVE, Immersadesk, and NGI technologies currently
applied to surgery
School of Biomedical and Health Information
Sciences and Department of Surgery, College of
Medicine
3
Virtual Reality in Medicine LaboratoryEstablished
1997
Medical artists Physicians Bioengineers Engineers
Programmers Graphics Experts
Integrating virtual reality technologies into
the practice of medicine

School of Biomedical and Health Information
Sciences and Department of Surgery, College of
Medicine
4
Underlying Theme

• Strength through Collaboration

5
Underlying Theme

• Strength through Collaboration, thus

is our natural partner
6
Next Generation Internet
List of Major Partners
Electronic Visualization Lab - UIC
7
VRMed Lab Mission

• The Killer App

8
Key Collaboration

• Electronic Visualization Lab
• - Virtual Reality systems, software and
  networking
• They develop, we apply
• Close collaboration

Electronic Visualization Lab
9
ImmersaDeskTM
Image by Tycho Hoogland
10
ImmersaDeskTM
Image by Tycho Hoogland
11
Tele-Immersive Virtual Reality

• Two or more ImmersaDeskTM systems
• stereo vision
• viewer centered perspective
• large angles of view
• interactivity
• Networked collaboration (using CAVERNsoft)
• converse, see each other, and point in 3D!

Electronic Visualization Lab
12
This project has been funded in whole or in part
with Federal funds from the National Library of
Medicine, National Institutes of Health, under
Contract No. N01-LM-9-3543.
13
This project has been funded in whole or in part
with Federal funds from the National Library of
Medicine, National Institutes of Health, under
Contract No. N01-LM-9-3543.
14
Adding Value via Collaboration
15
Biomedical Tele-Immersion for the Next Generation
Internet
Electronic Visualization and Networking Tom
DeFanti, PhD Biomedical Visualization and
Tele-Immersive Environment Co-PI Mary
Rasmussen, Ray Evenhouse, Sean Prokasy Greg
Blew, Fred Dech, Zhuming Ai, PhD, J.J.
Kempiners Domain (Colorectal, Otolaryngology, and
General Surgery) Russell K. Pearl, MD
Theodore Mason, MD W. Scott Helton,
MD Evaluation and Medical Education Marcia
Edison, PhD Principal and Co-Principal
Investigator Jonathan C. Silverstein, MD,
MS, Walter B. Panko, PhD
This project has been funded in whole or in part
with Federal funds from the National Library of
Medicine, National Institutes of Health, under
Contract No. N01-LM-9-3543.
16
Virtual Temporal Bone
Collaborators Dept. of Otolaryngology - Head and
Neck Surgery Dept. of Surgery, UIC Universiteit
Utrecht, Nederland
Department of Otolaryngology - Head and Neck
Surgery
17
Temporal Bone Anatomy

• Highly complex
• Critical to understanding common problems
• Surgeons conceptual visualization difficult to
  achieve with 2D illustrations or photos
• Cadaver dissection even difficult
• many repeated attempts to learn
• Few local experts in any region

Department of Otolaryngology - Head and Neck
Surgery
18
Temporal Bone Methods

• Histologic sections digitized
• Structures segmented by hand drawing around
  structures by medical artists with domain experts
• 3-Dimensional surface geometry files generated
• IsoView (Metro-Web), Cosmo Worlds (SGI)
• VRML 2.0 files displayed in Performer (SGI)
• Displayed in Networked ImmersaDesks using
  CAVERNsoft (Tele-Immersive Virtual Reality)

This project has been funded in whole or in part
with Federal funds from the National Library of
Medicine, National Institutes of Health, under
Contract No. N01-LM-9-3543.
19
Dept. of Otolaryngology - Head and Neck Surgery,
20
Browser Demonstration Version of Virtual Temporal
Bone
Department of Otolaryngology - Head and Neck
Surgery
21
Dept. of Otolaryngology - Head and Neck Surgery,
22
Dept. of Otolaryngology - Head and Neck Surgery,
23
Virtual Pelvic Floor
Collaborators Division of Colon and Rectal
Surgery, Cook County Hospital, Chicago,
IL Dept. of Surgery, UIC
Division of Colon and Rectal Surgery, Cook County
Hospital, Chicago
24
Virtual Pelvic Floor
Division of Colon and Rectal Surgery, Cook County
Hospital, Chicago
25
Virtual Pelvic Floor Video - Internet2 Members
Division of Colon and Rectal Surgery, Cook County
Hospital, Chicago
26
Virtual Pelvic Floor
Division of Colon and Rectal Surgery, Cook County
Hospital, Chicago
27
Virtual Pelvic Floor
Division of Colon and Rectal Surgery, Cook County
Hospital, Chicago
28
Virtual Pelvic Floor
Division of Colon and Rectal Surgery, Cook County
Hospital, Chicago
29
Division of Colon and Rectal Surgery, Cook County
Hospital, Chicago
30
Virtual Cranioplasty
Tele-Immersive environments for surgery

• Cranial defects due to disease or trauma
• Virtual Reality and virtual prototyping

31
(No Transcript)
32
(No Transcript)
33
(No Transcript)
34
(No Transcript)
35
(No Transcript)
36
(No Transcript)
37
(No Transcript)
38
(No Transcript)
39
(No Transcript)
40
Virtual Cranioplasty

• Expected Results
• Improved Appearance
• Improved Protection
• Surgery time cut to 1/3
• Hospital stay from 7 to 2 days
• Unexpected Results
• Increased blood flow to brain
• Increased cerebrospinal fluid (CSF) pressure
• Increased cognitive function

41
Eye Diseases in Virtual Reality
Collaborators Dept. Of Ophthalmology and Visual
Sciences, UIC Electronic Visualization Lab, UIC
42
Eye Diseases in Virtual Reality
43
Eye Diseases in Virtual Reality
44
Eye Diseases in Virtual Reality
45
Eye Diseases in Virtual Reality
46
Eye Diseases in Virtual Reality
47
Eye Diseases in Virtual Reality
48
Eye Diseases in Virtual Reality
Content expert Balaji K. Gupta
MD1 Production/direction Mary Rasmussen2 VR
software/programming Zhuming Ai2 Modeling Ja Lu
Lin3 1. Dept. of Ophthalmology and Visual
Sciences, UIC 2. VRMedLab, UIC 3. Electronic
Visualization Lab, UIC
49
Radiological Tele-Immersion for Next Generation
Networks
Distributed, collaborative, stereoscopic
visualization and manipulation of
three-dimensional radiological image data
Collaborators Dept. of Radiology, UIC Electronic
Visualization Lab, UIC
This project has been funded in whole or in part
with Federal funds from the National Library of
Medicine, National Institutes of Health, under
Contract No. N01-LM-9-3543.
50
Radiological Tele-Immersion
VR software/programming Zhuming Ai, PhD, Fred
Dech Content expert Jonathan Silverstein M.D.
This project has been funded in part with Federal
funds from the National Library of Medicine,
National Institutes of Health, under Contract No.
N01-LM-9-3543 and Grant R01-LM-06756-01.
51
Virtual Reality The Future has Arrived

3-Dimensional Education Simulations Pre-Treatment
planning
CAVE, Immersadesk, and NGI technologies
School of Biomedical and Health Information
Sciences and Department of Surgery, College of
Medicine
52
? 2000-1 University of Illinois at Chicago
53
Barriers yet to conquer
Cost Ubiquitous high-performance networking (1GB
gt) Cultural change

• Barr

54
Barriers yet to conquer
Cost trends are in right direction Ubiquitous
high-performance networking (1GB gt) Cultural
change may be hardest part

• Barr

55
Fit In?
Where Does

• Quality of Service (QoS) Issues

? 2000-1 University of Illinois at Chicago
56
QoS

• Basic Types
• Resource reservation
• Prioritization
• Need?
• More traffic
• More demanding applications
• In healthcare, applications demand more frequent.

? 2000-1 University of Illinois at Chicago
57
Tele-Immersion QoS Requirements

• Bandwidth needs High
• Priority High
• Multicast
• Guaranteed bandwidth

? 2000-1 University of Illinois at Chicago
58
Remote Surgery or Simulation QoS Requirements

• Bandwidth needs Moderate
• Priority Highest
• Low Latency
• Guaranteed bandwidth

? 2000-1 University of Illinois at Chicago
59
Distributed Anatomy Lab QoS Requirements

• Bandwidth needs Low-moderate
• Priority Low-medium
• Low Latency
• Guaranteed bandwidth Not needed

? 2000-1 University of Illinois at Chicago
60
Compared to other domains, the need for big
pipe is not as important.
Caveat
? 2000-1 University of Illinois at Chicago
61
TM
www.internet2.edu