SHOOGLE Excitatory Multimodal Interaction on Mobile Devices

1
SHOOGLE Excitatory Multimodal Interactionon
Mobile Devices

• presented by Tracy Rodrigues

2
What is Shoogle?

• A technology where the user just shakes, tilts or
  wobbles the device to get feedback about the
  state and contents of the cell phone. This
  feedback is auditory and vibrotactile.
• utilizes accelerometers, vibrators and internal
  speakers
• This makes certain interactions eyes-free and
  doesnt interrupt the user.

3
Motivation behind Shoogle

• Mobile devices can
• Disrupt tasks
• Cause socially unacceptable situations
• This could be solved with an alternate
  interaction style where the user excites
  information from the device.

4
Concepts Shoogle uses

• Ideas from nature/ environment
• Exploit human understanding of natural physical
  processes
• Give the device physically meaningful
  characteristics
• Display the internal state of mobile devices by
  sonifying and haptically rendering the contents
  of inboxes etc.
• Impact perception/ non visual channel
• E.g. distinguishing a hollow barrel from a full
  one after tapping it
• Using natural sounds
• E.g. Keys comforting sense of presence rather
  than an intrusive alarm

5
Scenarios

• Eyes free message box
• Keys in pocket
• Scenario Liquid Battery Life

6
Other Possible Scenarios

• Many other scenarios could be envisaged
• shaking an iPod to get an overview of the genres
  in a playlist
• exciting a contacts list, then sieving out
  potential interesting names
• sensing upcoming events in a schedule, sonifying
  their priority
• or sensing the files in memory, classified by
  size and type.

7
How does Shoogle work?

• The sensing hardware Accelerometers
• to transform motion into measureable signals
• The dynamics model
• to simulate the motion of the virtual objects
• The display
• which reveals the state of those objects

8
My Evaluation

• Pros
• Useful for people who have visual / fine motor
  impairments
• There are plenty of situations where getting
  visual information is inconvenient (e.g. cell
  phone is somewhere inside your bag)
• Redundant Information is a good design practice
• The natural sounds are pleasant and less
  intrusive than the usual cell phone sounds.
• Cons
• Shaking the phone for information?
• Need to be cautious while shaking
• Could be annoying when you are already in motion
  e.g. jogging
• How do the different scenarios work together?
  Shake it in different ways?
• Natural sounds distinguishable from actual keys
  / someone elses cell phone?

9
My Evaluation

• Testing Conducted
• Of the several dozen people who have
  experimented with Shoogle, all have found it
  captivating and intuitive
• Currently, only basic trials have been conducted,
  but more widespread testing is already in the
  cards (27th Nov 2007)
• Opinions range from Why??? Seems Useless!!! to
  that is so cool, I want one right now!

10
My Evaluation

• This interaction style has a lot of potential. It
  is particularly significant for users with visual
  or fine motor impairments. Haptic and audio
  feedback can be put to very good use in many non
  cell-phone situations as well.
• Shoogle is a really good technology that
  showcases this interaction style. But thought
  needs to be put into using it for more meaningful
  scenarios.
• In its present state it may not be extremely
  useful, but it may catch on as cool feature to
  have on your cell phone.

11
Extensions

• Can be used to make using cell phones easier for
  the visually impaired.
• Enable selection and then read the messages out
  to the user.
• Many possible scenarios
• Use it as a pedometer
• Shaking it to make it silent
• Shake to hear upcoming events based on priority
• Games which needs tilting, shaking

12

• Questions?