Linking the information world and physical world

1
Linking the information world and physical world

• Pattie Maes
• Ambient Intelligence Group
• Room 320

2
Focus of our group

• Integrating the rich content of the digital world
  into our everyday physical existence
• Providing just-in-time information that is
  highly relevant

3
ReachMedia On-the-move Interaction with
Augmented Objects Assaf Feldman, Sajid Sadi
2005

• Wireless RFID reader wristband reads tags in
  objects held by user
• Touching an object results in a menu of services
  and information
• Order a copy
• Read reviews
• Leave a message
• Retrieve messages
• Do a keyword search

4
ReachMedia On-the-move interaction with
Augmented Objects Assaf Feldman, Sajid Sadi
2005

• Wireless and mobile
• Natural and seamless, hands-free and eyes-free
  interaction option
• Gesture input (accelerometers on wristband)
• Audio output
• Keypad screen-based
  interaction option

5
Alternative (Private) Interface Peripheral
glasses display EMG - Enrico Costanza (2005)
Wearable peripheral display embedded in a pair
of eyeglasses delivers notification cues in a
private, subtle and non-obtrusive way
Electrodes on biceps pick up private and
non-obtrusive inputs
6
(No Transcript)
7
Invisible Media Sensing responding to visual
focus of attention - David Merrill 2005

• User wears earbud with IR emitter/receiver
• Augmented objects sense the users focus of
  attention
• Relevant information is presented in audio
  format
• Speech input

8
Invisible Media Sensing responding to visual
focus of attention - David Merrill 2005

• Ring interface

9
Invisible Media Sensing responding to visual
focus of attention - David Merrill 2005
Smart shelves application
10
Challenges in Just-in-time Information

• Just-in-time information is useful if it is
• likely to be relevant to the user
• Challenges in
• user profiling
• detecting context of user
• recommendation algorithms
  
• offered unobtrusively
• Challenges in
• Subtle interfaces
• requires minimal user effort to access
• Challenges in
• Natural, on-the-move interfaces
• safeguards the users privacy

11
Other Projects Augmenting Everyday Objects with
Specific Functionalities

• Responsive sticky notes
• Augmented pillows
• Responsive mirrors
• Augmented fabrics for clothing furniture
• Augmented doors, windows, walls, floors, clocks,

12
Augmented sticky notes - Mistry

Using RFID tags digitizer pad to enable
search and organization of physical sticky notes
13
SubTextile Sadi Mihkak
Enabling technology for I/O fabrics
applications in furniture everyday objects
14
Physically Actuated Displays Coelho
Use of nitenol memory wire to create I/O
fur (fuzzy kinetic display)
15
Paper circuit - Coelho
16
Flexible Urban Displays Bouchard Sadi
Flexible LED displays can be used to blanket
surfaces with displays
17
Siftable Computers Merrill Kalanithi
Small display devices with embedded
sensors allow for more tangible
experience interacting with applications
18
Summary

• Radically rethink user-information
  interaction by
• Offering just-in-time information
• Highly relevant to a unique user and their
  current focus of attention
• In non-disruptive, easily accessible, privacy
  protecting way
• May replace traditional keyboard/screen based
  interface