Ubiquitous Computing Platform based on Personal Spaces with LG Project

1
Ubiquitous Computing Platformbased on Personal
Spaces(with LG Project)

• Kyung-Lang Park
• (2007. 3.23)

2
Contents

• Background the history of computing
• Basic concepts
• Ubiquitous Object
• Personal space
• System architecture
• Operation flows
• Applications
• Future work

3
Background

• The world is divided into the real world and the
  virtual world
• The real world
• Real objects
• Humans, Cats, Desks, TV, etc.
• Real interaction (RI)
• Interaction between real objects
• Consume physical energies based on Physics
• The virtual world
• Virtual objects
• Software, Data, etc.
• Virtual interaction (VI)
• Interaction between virtual objects
• Change of a stream of bits

4
Background

• Real objects can interact with virtual objects
  via computers
• Computers can access both the real world and the
  virtual world
• Projection of Reality (PR)
• Reflection of Virtuality (RV)

Virtual world
VI
PR
RV
RI
RI
Real world
5
Background

• Computers has been evolving to minimize real
  interaction of humans
• Ubiquity of computers
• Integration of the virtual world
• Intelligence of virtual objects
• Natural interface of computers
• The ubiquitous computing is close to the ultimate
  computing infrastructure where RI is zero
• Computers are embedded into our daily life
• All of them are networked
• Context-awareness
• Invisible

6
Background

• Conceptual diagram of the ubiquitous computing

VI
VI
PR
RV
RI
RI
7
System concept

• Our system is based on the concept of the
  ubiquitous computing
• Providing users personalized services anytime
  anywhere seamlessly

U-Desk
U-Note
C
C
Services
U-Table
C
Interaction
U-Display
C
U-Object
C
Personal Space
8
Ubiquitous object

• Everything is represented as a ubiquitous object
• UOs freely discover and communicate each other
• Changes of UO are reflected to corresponding
  objects
• Some operations in the real world are converted
  into virtual interactions
• Ubiquitous objects provide ubiquitous services
• Two types of services
• Application services
• Include real interaction with users
• Utilize other services
• Infra services
• Provide unit function
• Every UO provides basic services
• UO information services
• Event services
• Control services
• Advantages of Ubiquitous Object Model
• Reducing the amount of users real interaction
• No regional restriction
• Flexible

9
Operation flow in the proposed system
Virtual World
UO
VI
VI
PR
RV
Real interaction
Real World
10
Personal space

• Users (ubiquitous objects) maintain their
  personal space
• Conceptual model of users current situation
• Personal computing environment
• Application services reflect users context by
  using their personal spaces
• Benefits
• Services use PS to generate user-centric
  operations
• Services are automatically activated according to
  PS
• PS includes a candidate set of services which
  will be possibly activated by the user or users
  other services
• User-centric resource management and conflict
  resolution
• Standard o user context

11
Personal Space Model

• Personal space model comprises of a set of
  ubiquitous objects and services that are related
  to users
• Elements in the personal space have state and
  relations
• State
• Available
• Use
• recognized
• Relation
• Have
• Use
• related

12
Representation of personal space
XML VPW Profile
Diagram
Equation
13
Upcoming computing environment
RFID/USN
Private object
Private object
Shared object
Real World
14
System architecture
Runtime Service Interface
Service Activator
Location Resolver
Bluetooth?
Object manager
UOs
User Proxy
UOs
UOs
TV UO
Personal Space Manager
Terminal UO
EM
Event Manager (Data Aggregator)
WLAN
COMM MODULE
COMM MODULE
WLAN, WAN
RFID/USN Mid
RFID/USN
15
Components

• Comm module
• Event manager
• Object manager
• User Proxy
• Terminal ubiquitous object
• Location resolver
• Service activator

16
Communication between UO

• Comm module
• Provide facilities to discover and communicate
  with other ubiquitous objects
• Two possibilities
• Peer-to-peer architecture
• No centralized registry
• Assume gateways
• Provide local registry of ubiquitous objects
• Access point of RFID/USN
• Notation
• UOID.SERVICE_NAME_at_COMMID
• Examples
• user32_at_comm123
• Terminal2_at_comm123
• user32.infoservice_at_p123

17
Event routing

• Events are routed via the network of comm modules
• Operation flow
• Event generated from an object
• It is projected in the ubiquitous object
• The event is loaded in a comm module
• The comm module discover the destination
• The comm module send the event to the destination
• Comm module at the destination receive the event
• Event manager receive the event and forward it to
  the corresponding object
• Object do something about it

18
Event manager

• Aggregate events
• A buffer of events
• Process events
• Filter unnecessary events
• Resend the event
• Generate higher level event if necessary
• Disseminate events
• Send events to corresponding ubiquitous objects

19
Object manager

• Object manager is a container of ubiquitous
  objects
• Provide the index of ubiquitous objects managed
  by the object manager

20
User proxy

• User proxy is a ubiquitous object of a user
• UP maintain the personal space for the user
• Personal space manager
• When the user invoke a service, user proxy
  provide the personal space of the user to the
  service

21
Managing personal space

• Personal space manager maintain the personal
  space with an intelligent logic
• U-ARE lightweight User Adaptive Rule Engine
  (e.g., ANFIS)

User Proxy
Personal space
Personal Space Manager
Main Event Processor
Terminal Object
Service vector
PersonalizationPoint
(Distance))
ServiceDescription
(UseRate)
(Necessity)
Pre-processor
(Redundancy)
(quality)
(Conflict)
(Type))
22
User-centric Adaptive service

• Application services obtain and use user context
  while the service is running
• User context usually includes
• ID
• Location
• Activity
• Device

23
Obtaining user context from PS
User Proxy (UOID 1042015)

• ID 10420154 ? UOID
• Activity A.b_service, B.c_service
• Location X329Y400
• Device _at_Terminal (CC/PP)

• Available objects and services A, B
• Preference of devices
• Focus RI??/????
• Dist RI Object? ??
• PS Span ??? ??? ??? ??
• PS Cost VI? Cost? ??? ??
• Rsize of Activated PS
• Vsize of APS

Personal space
Location Resolver(X329Y400)
24
Strong points

• Use dynamic instance to use user context
• vs. static information
• Clear definition of user context
• User centric ? Mobility support
• vs. local middleware
• Fast
• Connect with services

25
Service provision

• Service invocation
• User can discover and invoke services with
  service activator
• According to the policy services can be invoked
  automatically
• Service configuration
• When providing services, personal space are
  reflected in the behavior of services
• Service reconfiguration
• When the PS changed, PS container sends signal to
  the application
• Application performs the callback function
• Retrieve update of PS
• Service could be blocked when the PS do not
  satisfy the conditions to run the service
• Conflict resolution

Exclusive mode
Sharing mode
26
Example of service
27
Applications

• Ubiquitous contents delivery service
• Users send and receive multimedia contents
• While contents are delivering, the service
  consider users context (personal space)
• Use available, preferred device
• Contents are changed according to the device
  capability
• Consider users focus and distraction
• MyUbiSpace
• Users manage ubiquitous devices with their
  personal space
• Provide users convenient interface to control
  devices
• Personalized Navigation

28
Future work

• Concrete the system framework
• Considering real applications
• Implementing the prototype of Personal Space
  Engine
• Writing a paper
• User-centric context acquisition model for
  providing adaptive services (Mobile and Wireless
  computing Journal)
• Adaptive service model based on Personal Spaces
  (after implementation)
• SRS of P2P due on 3/31