ANIMATE ARTS SENIOR PROJECT PROPOSAL

1
ANIMATE ARTS SENIOR PROJECT PROPOSAL
2
CONCEPT
An interactive installation in which viewers
attention exerts selective force on perpetually
recombining graphic elements. The basic
installation model consists of a digital
projector, a motion camera to record duration and
region of viewer attention on the screen, and
software to process camera data while assembling
and animating the graphic elements via genetic
algorithms adapting dynamically to viewer
preferences.
3
SIMPLIFIED SCHEMA
1 A FIELD OF GRAPHIC ELEMENTS WITH PARTICULAR
PROPERTIES, CLUSTERED BY TYPE. PERPETUALLY
DRIFTING AND RECOMBINING.
4
SIMPLIFIED SCHEMA
VIEWER ATTENTION
2 VIEWER ATTENTION DRAWN TO A PARTICULAR GRAPHIC
ELEMENT, CAMERA IMAGE PROCESSING CODE RECORDS
ZONE OF ATTENTION
5
SIMPLIFIED SCHEMA
3 ATTENTION STATISTICS DETERMINE FITNESS OF
PARTICULAR ELEMENT DURING RECOMBINATION
6
SIMPLIFIED SCHEMA
4 SYSTEM GROWS/EVOLVES TO REFLECT VIEWER ATTENTION
7
DATA FLOW
OBSERVERS
CAMERA
IMAGE PROCESSING
OBSERVER ATTENTION STATISTICS
GENETIC ALGORITHMS
GRAPHIC ASSEMBLY, SIMULATION ANIMATION
PROJECTOR
PROJECTED ANIMATION
8
RISKS / DIFFICULTIES
Viewer Attention Measurement

• Viewer attention statistics determine visual
  recombination
• How to measure looking?
• Ideal Eye Tracking
• Serious technical hurdles
• How to track groups of people, glasses, assorted
  eye shapes, etc.
• Insufficient camera resolution at typical
  viewing distance
• Alternative Eye / Face / Location Detection
• Give viewers a choice of screens / viewing
  locations
• Detect when viewer is facing a particular screen
• Measure duration, number of eyes, etc.

9
INSTALLATION DESIGN
10
INSTALLATION DESIGN
11
INTEREST

• Decisions in the midst of visual overload
• The process of looking
• Aggregation of preferences
• Consensus without communication
• Creative machines
• What aesthetic might emerge from graphic
  recombination?
• Human/machine interaction
• Exploration and learning processes

12
PRECEDENT

• Komar and Melamids Most Wanted / Unwanted
  Paintings
• Visualize aggregated
• national preferences

• Simon Pennys Petit Mal
• Human / machine interaction exploration

Andrea Pollis Intuitive Ocusonics Eye-tracking
musical interface
13
EXECUTION

• IMAGE PROCESSING
• Acquire camera, get a sense of the data stream
• Research open source options
• Code image processing system optimized for this
  application
• Code data structure for storing / sending
  viewing statistics
• ANIMATION
• Generate/collect/photograph graphic elements
• Develop aesthetic, design and code model of
  recombination
• Code dynamic animation / interface with viewing
  statistics
• LOGISTICS
• Find gallery space
• Secure grant / funding if necessary

14
RESOURCES