Vector Symbolic Architectures: A New Building Material for AGI

1
Vector Symbolic Architectures A New Building
Material for AGI

• Simon D. Levy
• Washington Lee University
• Lexington, Virginia, USA
• Ross Gayler
• Veda Advantage Value Solutions
• Melbourne, Australia

2
The Yin Yang of Intelligence
3
(No Transcript)
4
(No Transcript)
5
The Need for New Representational Principles

• Ecological affordances (Gibson 1979)
• Distributed/Connectionist Representations (PDP
  1986)
• Holographic Representations (Gabor 1971 Plate
  2003)
• Fractals / Attractors / Dynamical Systems (Tabor
  2000 Levy Pollack 2001)

6
Fractal RAAM
7
The Appeal of Connectionism(Rumelhart
McClelland 1986)
8
WALKED
WALK
9
ROARED
ROAR
10
SPOKE
SPEAK
11
WENT
GO
12
Mary wont give John the time of day.
ignores(mary, john)
13
The Binding Problem

?
?
?
?
14
Solution? Local Representations
15
Local Representations
16
The Problem of Two
?
17
The Problem of Variables
ignores(X, Y)
X wont give Y the time of day.
18
Vector Symbolic Architectures(Plate 1991
Kanerva 1994 Gayler 1998)
19
Tensor Product Binding(Smolensky 1990)
20
Binding
21
Bundling


22
Unbinding (query)
23
Lossy
24
Lossy
25
Cleanup
Hebbian / Hopfield / Attractor Net
26
Reduction
27
Composition / Recursion
28
Variables
X
29
Current Applications

• Modeling Surface and Structural Properties in
  Analogy Processing (Eliasmith Thagard 2001)
• Variables Quantification / Wason Task
  (Eliasmith 2005)
• Representing Word Order in a Holographic Lexicon
  (Jones Mewhort 2007)

30
Future Work Banish the Homunculus
MSC (Arathorn 2002)
31
Future Work Banish the Homunculus
MSC (Arathorn 2002)