Unified Cognitive Science

1
Unified Cognitive Science

• Neurobiology
• Psychology
• Computer Science
• Linguistics
• Philosophy
• Social Sciences
• Experience
• Take all the Findings and Constraints Seriously

2
What are schemas?

• Regularities in our perceptual, motor and
  cognitive systems
• Structure our experiences and interactions with
  the world.
• May be grounded in a specific cognitive system,
  but are not situation-specific in their
  application (can apply to many domains of
  experience)

3
Basis of Image schemas

• Perceptual systems
• Motor routines
• Social Cognition
• Image Schema properties depend on
• Neural circuits
• Interactions with the world

4
Image schemas
LM
TR

• Trajector / Landmark (asymmetric)
• The bike is near the house
• ? The house is near the bike
• Boundary / Bounded Region
• a bounded region has a closed boundary
• Topological Relations
• Separation, Contact, Overlap, Inclusion, Surround
• Orientation
• Vertical (up/down), Horizontal (left/right,
  front/back)
• Absolute (E, S, W, N)

5

• Similarity
• Perceptual and motor systems
• Basic functional interactions with the world
• Environment
• Variation
• Cross-linguistic variation in how schemas are
  used.

6
Cross-linguistic Variations
7
English
8
Japanese
9
Tamil
10
English
Bowerman Pederson
11
Dutch
Bowerman Pederson
12
Chinese
Bowerman Pederson
13
Spatial schemas

• TR/LM relation
• Boundaries, bounded region
• Topological relations
• Orientational Axes
• Proximal/Distal

14
Trajector/Landmark Schema

• Roles
• Trajector (TR) object being located
• Landmark (LM) reference object
• TR and LM may share a location (at)

15
TR/LM -- asymmetry

• The cup is on the table
• ?The table is under the cup.
• The skateboard is next to the post.
• ?The post is next to the skateboard.

16
Boundary Schema
Roles Boundary Region A Region B
Region A
Region B
Boundary
17
Bounded Region

• Roles
• Boundary closed
• Bounded Region
• Background region

18
Topological Relations

• Separation

19
Topological Relations

• Separation
• Contact

20
Topological Relations

• Separation
• Contact
• Coincidence

21
Topological Relations

• Separation
• Contact
• Coincidence
• - Overlap

22
Topological Relations

• Separation
• Contact
• Coincidence
• Overlap
• Inclusion

23
Topological Relations

• Separation
• Contact
• Coincidence
• Overlap
• Inclusion
• Encircle/surround

24
Orientation

• Vertical axis -- up/down

up
above
upright
below
down
25
Orientation

• Horizontal plane Two axes

26
Language and Frames of Reference

• There seem to be three prototypical frames of
  reference in language (Levinson)
• Intrinsic
• Relative
• Absolute

27
Intrinsic frame of reference

left
back
front
right
28
Relative frame of reference
right??
back
front
left??
29
Absolute frame of reference

west
south
north
east
30
TR/LM and Verticality Schemas

• The book is under the table.

up
down
under
31
Proximal/Distal Schema

• .

32
Simple vs. Complex Schemas
33
Container Schema

• Roles
• Interior bounded region
• Exterior
• Boundary

C
34

TR/LM Container
out
in
C
C
TR

• TR

35
Container Schema Elaborated

• Complexities more roles/specifications
• Boundary properties
• Strength
• Porosity
• Portals

36
Container schema logic
C
B
A

• x

37
Source-Path-Goal

• Constraints
• initial TR at Source
• central TR on Path
• final TR at Goal

Source
Path
Goal
38
SPG -- simple example

• She drove from the store to the gas station.
• TR she
• Source the store
• Goal the gas station

Source
Path
Goal
39
SPG and Container

• She ran into the room.
• SPG. Source ? Container.Exterior
• SPG.Path ? Container.Portal
• SPG. Goal ? Container.Interior

40
PATH landmarks

• past across along

LM
LM
LM
41
Part-Whole Schema
Part
Whole
42
Representing image schemas
semantic schema Container roles interior ext
erior portal boundary
semantic schema Source-Path-Goal roles source
path goal trajector
Boundary
Interior
Trajector
Portal
Source
Goal
Path
Exterior
These are abstractions over sensorimotor
experiences.
43
Language and Spatial Schemas

• People say that they look up to some people, but
  look down on others because those we deem worthy
  of respect are somehow above us, and those we
  deem unworthy are somehow beneath us.
• But why does respect run along a vertical axis
  (or any spatial axis, for that matter)? Much of
  our language is rich with such spatial talk.
• Concrete actions such as a push or a lift clearly
  imply a vertical or horizontal motion, but so too
  can more abstract concepts.
• Metaphors Arguments can go back and forth, and
  hopes can get too high.

44
Regier Model Lecture
Jerome A. Feldman February 27, 2007 With help
from Matt Gedigian
45
Neural Theory of Language
46
Language Development in Children

• 0-3 mo prefers sounds in native language
• 3-6 mo imitation of vowel sounds only
• 6-8 mo babbling in consonant-vowel segments
• 8-10 mo word comprehension, starts to lose
  sensitivity to consonants outside native language
• 12-13 mo word production (naming)
• 16-20 mo word combinations, relational words
  (verbs, adj.)
• 24-36 mo grammaticization, inflectional
  morphology
• 3 years adulthood vocab. growth,
  sentence-level grammar for discourse purposes

47
(No Transcript)
48
(No Transcript)
49
Trajector/Landmark Schema

• Roles
• Trajector (TR) object being located
• Landmark (LM) reference object
• TR and LM may share a location (at)

50
TR/LM -- asymmetry

• The cup is on the table
• ?The table is under the cup.
• The skateboard is next to the post.
• ?The post is next to the skateboard.

51
(No Transcript)
52
Language and Frames of Reference

• There seem to be three prototypical frames of
  reference in language (Levinson)
• Intrinsic
• Relative
• Absolute

53
(No Transcript)
54
Basis of Image Schemas

• Perceptual systems
• Motor routines
• Social Cognition
• Image Schema properties depend on
• Neural circuits
• Interactions with the world

55
Image schemas
LM
TR

• Trajector / Landmark (asymmetric)
• The bike is near the house
• ? The house is near the bike
• Boundary / Bounded Region
• bounded region has a closed boundary
• Topological Relations
• Separation, Contact, Overlap, Inclusion, Surround
• Orientation
• Vertical (up/down), Horizontal
• Absolute (E, S, W, N)

56
Spatial schemas

• TR/LM relation
• Boundaries, bounded region
• Topological relations
• Orientational Axes
• Proximal/Distal

57
Regiers Model

• Training input configuration of TR/LM and the
  correct spatial relation term
• Learned behavior input TR/LM, output spatial
  relation

58
(No Transcript)
59
Issue 1 Implicit Negatives

• Children usually do not get explicit negatives
• But we wont know when to stop generalizing if we
  dont have negative evidence
• Yet spatial relation terms arent entirely
  mutually exclusive
• The same scene can often be described with two or
  more spatial relation terms (e.g. above and
  outside)
• How can we make the learning problem realistic
  yet learnable?

60
(No Transcript)
61
(No Transcript)
62
(No Transcript)
63
Dealing with Implicit Negatives

• Explicit positive for above
• Implicit negatives for below, left, right, etc
• in Regier
• E ½ ?i,p (( ti,p oi,p) ßi,p )2,
• where i is the node, p is the pattern,
• ßi,p 1 if explicit positive,
• ßi,p lt 1 if implicit negative

64
(No Transcript)
65
(No Transcript)
66
(No Transcript)
67
(No Transcript)
68
Learning System
dynamic relations (e.g. into)
structured connectionistnetwork (based on
visual system)
69
(No Transcript)
70
(No Transcript)
71
(No Transcript)
72
(No Transcript)
73
(No Transcript)
74
(No Transcript)
75
(No Transcript)
76
(No Transcript)
77
(No Transcript)
78
Topological Relations

• Separation
• Contact
• Coincidence
• Overlap
• Inclusion
• Encircle/surround

79
Issue 2 Shift Invariance

• Backprop cannot handle shift invariance (it
  cannot generalize from 0011, 0110 to 1100)
• But the cup is on the table whether you see it
  right in the center or from the corner of your
  eyes (i.e. in different areas of the retina map)
• What structure can we utilize to make the input
  shift-invariant?

80
(No Transcript)
81
(No Transcript)
82
(No Transcript)
83
(No Transcript)
84
Limitations

• Scale
• Uniqueness/Plausibility
• Grammar
• Abstract Concepts
• Inference
• Representation

85
Demo of the Regier System

• on the English above

86
Language and Thought

• We know thought (our cognitive processes)
  constrains the way we learn and use language
• Does language also influence thought?
• Benjamin Whorf argues yes
• Psycholinguistics experiments have shown that
  linguistics categories influence thinking even in
  non-linguistics task

Language
Thought
cognitive processes