Whole Body Interaction Workshop

1
Whole Body Interaction Workshop

• HCI2008 September 1st, 2008

2
AGENDA

• 09.00-10.30 Presentations
• 10.30-11.00 Coffee in room 322/324
• 11.00-12.30 Presentations
• 12.30-13.30 Lunch in room 322/324
• 13.30-15.00 Discussion
• 15.00-15.30 Coffee in room 322/324
• 15.30-17.00 Discussion/Ways Forward

3
AGENDA

• Presentations
• 15 minutes
• No time limit for discussions
• Discussion 1
• Towards Everyday WBI
• Discussion 2
• Ways forward
• Research Agenda
• ITN ?

4
Whole Body Interaction

• Developments
• Improved and Marker-less motion capture
• Stanford
• Advanced Interaction frameworks
• Jacob CHI2008
• Experiments by artists
• Nimoy, Rokeby, Botto
• Bio-cybernetics and Biomechanics
• Understanding of patterns/gestures of movement
• Understand of human capabilities/limitations
• And ?

5
LJMU

• HCI Fun project

6
LJMU

• .

7
LJMU
8
Some Initial Questions

• What would be the criteria for a useful and
  successful framework for addressing the research
  questions of Whole Body Interaction?
• What are some of the basic lessons that can be
  learned from previous attempts to framework the
  topic?
• Can we come up with a set of concepts and a
  terminology to support interdisciplinary design,
  analysis and evaluation?

9
Questions

• The mappings of the bodies movement to the
  systems interpretation of that movement were
  movements required physically possible. Does the
  system only expect normal movements what of
  abnormal, exaggerated or other out of range
  movements?
• What is the users understanding and
  comprehension of the mappings and metaphors of
  their movement to system reaction? Could the user
  and system mutually adapt or would users be
  forced to adapt their body movements?

10
Questions

• What is the scope of whole body interaction and
  body as a data source for
• Physical Presence/Cartesian Space posture,
  movement, location, orientation
• Physiological Heart rate, breathe volume and
  rate, skin resistance as both data and control
• Human senses taste, smell, kinesthetic, vision,
  speech/sound, balance and the possibilities for
  synaesthesia between two or more senses.

11
Discussions

• Towards an everyday Whole Body Interaction
• As ubiquitous as mouse keyboard
• How?
• Ways forward
• Research agenda
• Special Issue
• CHI2009 Workshop (submitted)
• FP7 Activities
• COST, ITN

12

• Limitations/Constraints as source of creativity
• Lessons, work-arounds
• Attending to the display vs inattentive
  interaction
• Underlying physical/human models
• Precision, drift
• Multiple people occlusion, model deformation

13

• Non-standing interaction
• Feet as reference point
• MoCap infrastructure vs. in the field
• Micro-computers, SunSpots etc in the field
  devices
• Experience of embodied interaction
• Analysis software, filters
• How to study lessons from sports science,
  biomechanics etc

14

• Vs Emotional, subjective
• Quality, coordination of movement and experience
  value judgement rather than motion analysis
• Contexts, maths models, environment, goals (if
  any) complex framework
• Interactions, awareness of others

15

• Albrecht Schmidt Essen
• Eva Hornecker Strathclyde
• Externals Paul Dourish
• Eindhoven ??
• European Network Body Movement
• France, Cog. Sci Benoit Bardy Montepellier
• Euro Centre for movement science

16

• FP7 priorities and themes
• Does games fit? Games as a Lab environment
• Engaging
• Limited data, best fit parameters
• Model/Middleware lt- embodiment, biomechanics
• Cog Sci,

17

• Re-Representing data to users
• End user programming
• Adaptation
• Context
• Mutual emergent understanding
• User tools
• Open source micro-platforms
• Standards, platforms and APIs, and data

18

• Forms of data
• Cross over from theory to practical use e.g.
  Space theory
• Application drive?
• Geospatial
• Medical
• Games
• Security
• Existing areas augmented by WBI

19

• Negative Privacy, tracking, ethics
• http//www.guardian.co.uk/uk/2008/jul/21/civillibe
  rties.privacy
• http//news.bbc.co.uk/1/hi/magazine/7348164.stm
• Interventions
• Embodied education
• Achievement, pre-verbal, imitation
• Limits of gesture recognition

20

• Embodied knowledge, intelligence
• Teaching other knowledge words etc