Visualizing%20Non-Verbal%20Behavior%20in%20Small%20Group%20Interactions

1
Visualizing Non-Verbal Behavior in Small Group
Interactions

• how to make friends without speaking

2
Overview

• Address the modeling and sensing aspects of
  situationally appropriate systems
• Focus on small group interactions
• Meeting room behavior
• Small group public spaces
• Provide insight for automating sensing and
  modeling

3
Project Goals

• Develop and produce a high-level description of
  meeting group interactions
• Produce data visualizations that may be used to
  inform modeling and sensing

4
Project Proposal

• Stage 1 literature review and development of
  coding / notational description system
• Stage 2 collect data and create metadata
  descriptions using coding system
• Stage 3 produce visualizations of data to
  further understand potential utility of captured
  sensor data

5
Stage 1

• Literature review to uncover list of target
  behaviors
• Develop notational coding system of chosen
  behaviors

6
What To Look For?

• Types of data
• Non-verbal behavioral data
• Spatial orientation
• Spatial activity
• Auditory cues (see Foote, Boreczsky Wilcox,
  1999)
• Localization
• Duration
• Level

• Levels of granularity
• Event data
• Transitional events
• Indicator events (e.g., handshakes)
• Sequential event data
• Large scale temporal data

7
Example Events

• Interacting groups form structural arrangements
  in space (event group formation)
• Handshakes may signify beginning of meeting

8
Example Sequential Event
Sequential Events During group discussions, short
glances of gt 30 degrees occur. However, sustained
glances of gt 30 degrees usually lead to
reorientation of entire body (Kendon, 1990)
9
Group Spatial Arrangements
10
Example Large Scale Temporal Patterns

• Traffic Patterns
• Gather data on traffic patterns
• Rythmic Auditory Patterns
• Examine patterns of vocal interaction over time
  (e.g., speaker1-speaker2-speaker3, vs.
  speaker1-speaker1-speaker1)

11
Sample Concepts for Coding Scheme

• Individual
• Head Frw, L, R
• Body (N, NE, E, SE, S, SW, W, NW)
• Group Spatial Formations
• F-Form
• O-Form

• Auditory
• Actori speaking
• Global activity
• Rhythm (Erickson, 1991)
• Traffic Patterns
• Activity level
• Path frequency

12
Stage 2

• Collect data
• Review videos and code data

13
Collecting The Data

• Outfitted meeting room
• Localized ceiling mics
• Wide angle camera on the ceiling
• 2 to 3 wall-mounted or tripod digital video
  recorders
• Alternatively, use pre-recorded meetings as
  source data

14
Stage 3

• Develop visualization of these data
• Allow users to explore visualizations and gather
  information regarding human perception of
  patterns
• Use this user data to facilitate formation of
  models

15
The Group Visualizer
16
Questions?