Designing a multimedia interactive to support shared learning experiences

1
Designing a multimedia interactive to support
shared learning experiences

• Steve DiPaola Caitlin Akai
• Simon Fraser University

Siggraph Boston 2006 Educators Workshop
2
Outline

• Technology in informal learning spaces
• Design issues for multimedia interactives
• Introduction to the Virtual Beluga project
• Technical description of the simulation
• Educational content
• Interaction design

3
Technology in informal learning spaces

• Informal learning spaces like museums, sciences
  centres and aquaria are increasingly
  incorporating technology into their exhibits
• These spaces contain many design constraints that
  can limit the potential of technology
• Appropriate design of multimedia exhibits can
  ensure technology enhances educational content
  and visitor experience

4
Design issues for multimedia interactives

• Need for robustness
• Limited contact time
• Exhibits must work without supervision
• High traffic/use
• Visitors travel in groups
• Need to generate repeat visits
• Educational content should be engaging and
  accessible

5
Virtual Beluga Project

• In collaboration with Vancouver Aquarium and Bill
  Kraus from Digital Biology
• Highly realistic dynamic virtual beluga
  simulation
• Interaction goal was to create a user-centric,
  shared, collaborative, and reflective learning
  space
• Important to encourage deeper interaction with
  the content than what is available through
  traditional wall signage or video

6
Overview of vBeluga

• Virtual belugas are shown in a wild pod context
• Incorporates research on beluga behavior and
  vocalization conducted at aquarium
• Simulation is based on artificial intelligence
  architecture so belugas can learn and alter their
  behavior based on changes in their environment
• Physically-based system allows for natural whale
  locomotion and realistic water
• Realistic graphics achieved through the use of
  actuators (virtual bones and muscles)

7
Simulation System

• Variable content is supported - individual
  organisms can grow and change over time, new
  organisms can be added/removed
• Easy to update to reflect changes in current
  scientific thinking
• The non-deterministic nature of the simulations
  means that no two simulations are alike
• The system is fully scalable - the number and
  complexity of organisms is limited only by the
  speed and memory of the computer on which it runs
• Behavioral system consists of two layers
• A low level navigational system
• A high level action selection system

8
Adaptive behavior system

• Advanced Layer Action Selection
• - Suite of behaviors (action selection)
• Internal state
• Memory of past events
• Primitive Layer Navigation
• Navigation and obstacles
• Neural network bridging sensors and actuators

9

10
Educational messages

• Data from researchers, aquarium staff and
  visitors was incorporated into the interactive
• Key educational messages
• Belugas live in an acoustic world
• Human activities affect the way belugas use sound
  to navigate and communicate
• Our knowledge of wild beluga behavior is very
  limited

11
(No Transcript)
12
Interaction Design Goals

• To allow visitors to engage in interactive
  what-if scenarios
• Focus on collaboration - especially between adult
  children
• Technology removed from direct visitor contact
• Visitors should not control wild belugas
• Solution Camera tracked tabletop
• Flexibility

13
Designing for flexibility

• Modularity
• Open-ended scenarios
• Layers
• Scalability

14
Flexibility of use

• General gallery
• Summer camp
• Beluga encounters
• Corporate events

15
Conclusion

• Effective design of multimedia interactives can
  overcome some of the constraints associated with
  public informal learning spaces
• Highly realistic simulations can provide a novel
  and engaging format for presenting educational
  content
• Dynamic open-ended scenarios used to encourage
  collaboration and interaction among a range of
  visitors

16
Our competition
17
Acknowledgments

• Steve DiPaola
• Bill Kraus of Digital Biology
• Vancouver Aquarium
• Valerie Vergara - PhD student and aquarium
  researcher
• For more information see
• http//ivizlab.sfu.ca/research