Learning in the Brain Recognition and Representation in Cortex

1
Learning in the BrainRecognition and
Representation in Cortex
2
Recognition Networks - Distributed
3
(No Transcript)
4
Recognition Networks - Parallel
5
(No Transcript)
6
The McGurk effect and parallel processing
What about students with learning disabilities?
Integration of heard and seen speech a factor
in learning disabilities in children Erin A.
Hayesa,, Kaisa Tiippanab, Trent G. Nicola, Mikko
Samsb, Nina Krausa,c,d
7
Recognition Networks - Heterarchical
8
Whats wrong with this diagram?
See Top to Bottom highlights
9
Illusions as top-down constraints on
understanding images.
Shadow
Presidential Illusion
Ball and Shadow
Illusions Reveal the Brain's Assumptions
On Illusions From Top to Bottom
10
Recognition Cortex

• Recognition cortex (sensory perceptual cortex in
  the posterior neocortex) is composed of neural
  networks adapted to recognize regularities in the
  environment.
• Recognition cortex does not respond to these
  regularities, it generates them.

11
Structure in Recognition Cortex

• Structure is sculpted by learning specifically
  by learning the regularities of the environment
• There is no optimal structure, the optimal
  structure is dependent on the kind of
  memory/perception/learning is needed.
• Overall structure is a network of networks
  there is specialization and localization
  determined by learning
• There are many specialized networks not 5
  senses, but many. 30 visual networks alone.

12
Learning in Recognition Cortex

• Recognition cortex learns by changing its
  structure by changing the connections between
  neurons that make up the network.
• Learning is a change in the way the network acts.
• Learning is a dynamic process not a static one.
• Piaget was right assimilation is accompanied
  by accommodation.

13
What does recognition require? An integrated
network, where meaning is constructed
heterarchically from the massive interplay
of perceptual constancies symbolic information
and cognitive experience.
14
Recognition Networks
What kind of barriers arise?
15
Recognition Networks
What kind of barriers arise? Perceptual
Barriers Linguistic and Symbolic barriers
Cognitive Barriers
16
Recognition Networks
Overcoming the barriers Multiple
Representations Perceptual Options Linguistic
Options Cognitive Options
17
Multiple Representations
1) Cognitive Options Priming background
knowledge Providing multiple examples and
non-examples Highlighting critical features and
relationships Scaffolding strategies for
comprehension Supporting memory and transfer 2)
Linguistic Options Providing semantic
(vocabulary) alternatives Providing syntactic
alternatives Providing background language
alternatives 3) Perceptual Options Providing
verbal descriptions for Images Providing spoken
equivalents for Text Providing captions for
Speech
18
Practice Teaching someone to recognize a
Federal Style house.
19
Recognizing a Federal Style House One
representation
The Federal Style House
The Federal Style house is usually a simple box,
two or more rooms deep, with doors and windows
arranged in strict symmetry. The box may be
modified by projecting wings or attached
dependencies. The stylistic focus is on the main
entry -- a paneled door often framed by half or
three-quarter length sidelights and thin
pilasters or columns. The door is often crowned
by a fanlight, or entabulature.
20
What kinds of barriers does this representation
raise, for whom?
The Federal Style House
The Federal Style house is usually a simple box,
two or more rooms deep, with doors and windows
arranged in strict symmetry. The box may be
modified by projecting wings or attached
dependencies. The stylistic focus is on the main
entry -- a paneled door often framed by half or
three-quarter length sidelights and thin
pilasters or columns. The door is often crowned
by a fanlight, or entabulature.
Perceptual Linguistic Cognitive
21
What kinds of barriers does this representation
raise, for whom?
The Federal Style House
The Federal Style house is usually a simple box,
two or more rooms deep, with doors and windows
arranged in strict symmetry.
Perceptual Linguistic Cognitive
22
The Concept of the Federal Style House An
alternate representation
A Federal Style House
23

• Perceptual Options
• Examples Images with verbal
  equivalents
• Spoken Equivalents for Text
• Captions for Speech

longdesc
24

• Perceptual Options
• Examples Verbal Descriptions
  for Images
• Spoken Equivalents for Text
• Captions for Speech

The Federal Style house is most commonly a simple
box, two or more rooms deep, with doors and
windows arranged in strict symmetry. The box may
be modified by projecting wings or attached
dependencies. The stylistic focus is on the main
entry -- a paneled door often framed by half or
three-quarter length sidelights and thin
pilasters or columns. The door is often crowned
by a fanlight or an entablature.
25

• Perceptual Options
• Examples Verbal Descriptions
  for Images
• Spoken Equivalents for Text
• Captions for Speech

video
26
Multiple Representations
The Federal Style house is most commonly a simple
box, two or more rooms deep, with doors and
windows arranged in strict symmetry. The box may
be modified by projecting wings or attached
dependencies. The stylistic focus is on the main
entry -- a paneled door often framed by half or
three-quarter length sidelights and thin
pilasters or columns. The door is often crowned
by a fanlight, or entabulature.
27
Picture Descriptions (How to)
Making a Picture Description

First, understand the purpose of the
image Second, start with a broad overview, the
big picture Third, focus on a few relevant
details (see Purpose) Fourth, describe
relationships and comparisons Fifth, leave
interpretations to the observer.
28
Multiple Representations
Linked Representations
Iris demo
29
Principle One Multiple Representations
1) Perceptual Options Options in the
display of information Options for auditory
info Options for visual information transform
ations within vision transformations to other
senses 2) Linguistic Options 3)
Cognitive Options

30
Multiple Representations
1) Cognitive Options Priming background
knowledge Providing multiple examples and
non-examples Highlighting critical features and
relationships Scaffolding strategies for
comprehension Supporting memory and transfer 2)
Linguistic Options Providing semantic
(vocabulary) alternatives Providing syntactic
alternatives Providing background language
alternatives 3) Perceptual Options Providing
verbal descriptions for Images Providing spoken
equivalents for Text Providing captions for
Speech
31
Multiple Representations
1) Perceptual Options 2) Linguistic
Options Definitions for vocabulary Clarificati
ons for syntax and structure Decoding of text
and symbols Alternatives for cross-linguistic
info Illustrations for info in text or
language 3) Cognitive Options

32
2) Linguistic Options Example
Definitions for vocabulary
Translations for English Alternative
syntactic complexity
The Federal Style house is most commonly a simple
box, two or more rooms deep, with doors and
windows arranged in strict symmetry. The box may
be modified by projecting wings or attached
dependencies. The stylistic focus is on the main
entry -- a paneled door often framed by half or
three-quarter length sidelights and thin
pilasters or columns. The door is often crowned
by a fanlight or an entablature.
33
2) Linguistic Options Example
Definitions for vocabulary
Translations for English Alternative
syntactic complexity
The Federal Style house is most commonly a simple
box, two or more rooms deep, with doors and
windows arranged in strict symmetry. The box may
be modified by projecting wings or attached
dependencies. The stylistic focus is on the main
entry -- a paneled door often framed by half or
three-quarter length sidelights and thin
pilasters or columns. The door is often crowned
by a fanlight or an entabulature.
In English
En Espanol
34
Multiple Representations
1) Cognitive Options Priming background
knowledge Providing multiple examples and
non-examples Highlighting critical features and
relationships Scaffolding strategies for
comprehension Supporting memory and transfer 2)
Linguistic Options Providing semantic
(vocabulary) alternatives Providing syntactic
alternatives Providing background language
alternatives 3) Perceptual Options Providing
verbal descriptions for Images Providing spoken
equivalents for Text Providing captions for
Speech
35
3) Cognitive Options Providing Background
Information
It's easy to confuse Federalist architecture with
the earlier Georgian Colonial style. The
difference is in the details While Georgian
homes are square and angular, a Federal style
building is more likely to have curved lines and
decorative flourishes. Federalist architecture
was the favored style in the United States from
about 1780 until the 1830s. However, Federalist
details are often incorporated into modern
American homes. Look past the vinyl siding, and
you may see a fanlight or the elegant arch of a
Palladian window.
36
3) Cognitive Options Example
Activating background knowledge
37
3) Cognitive Options Example
Activating background knowledge
38
3) Cognitive Options Example
Activating background knowledge
39
3) Cognitive Options Example
Activating background knowledge Providing
alternative examples
40
Federal Style Buildings Examples
41
Non-examples Gothic Revival Buildings
42
Non-examples Greek Revival Buildings
43
Non-examples Georgian
44
3) Cognitive Options Example
Highlighting Critical Features
Prominent End Chimneys
Low Hipped Roof
Symmetrical, Multi-pane windows
Fanlight Over Door
45
3) Cognitive Options Example
Highlighting Critical Features, Relationships
1800 1810 1820 1830 1840 1850 1860 1870
1880 1890 1900 1800 Georgian
1810 Federal
1825 Greek Revival
1840 Victorian
1855 Second Empire
1880 Harvard Mills
46
3) Cognitive Options Example
Guiding exploration and examination
Progressive exposure
First, look at the main entrance, does it have
Classical Entrance? Fanlight over the door?
Small side panels or lites?
47
Second, look at the front façade, does it have
Palladian window in center? Windows arranged
symmetrically? Entabulature over front
entrance? ,
48
Third, look at the roof, does it have
Low-pitched roof? Balustrade? Prominent End
Chimneys?
49
1) Cognitive Options Example
Facilitating memory and transfer

• Federal Features
• F anlight over front door
• E nd Chimneys
• D entil Moldings
• E ven or symmetrical windows
• R oof over front door
• A Palladian Window
• L ow Hipped roof

50
3) Cognitive Options Example
Facilitating memory and transfer
51
3) Cognitive Options Example
Facilitating memory and transfer
52
3) Cognitive Options Example
Facilitating memory and transfer
53
3) Cognitive Options Example
Facilitating memory and transfer
54
Alt tags and Long Descriptions
Picture of a Federal Style house. The image
shows a single home setting on a large landscaped
lawn and garden. The house is two stories tall
and made of brick with a low pitched roof and
four prominent chimneys placed at the ends of the
roof. Overall there is a distinctively
symmetrical arrangement of the buildings
features. There is a central entrance with a
fanlight over the door and small windows
alongside. Two rows of evenly spaced
multiple-pane windows with black shutters are
arranged symmetrically around the entrance.
Return
55
Vocabulary
Fanlight A fanlight is a semicircular or
semi-elliptical window over a doorway or another
window. Federal homes often have fanlights.
Return
56
Vocabulary
Entablature Entablature is the elaborate,
multi-level beam that sits on top of the columns
in classical architecture.
Return
57
3) Provide cognitive options in the way
information is presented. Prime or
activate background knowledge
(advanced organizers, pre-teaching, analogies,
multiple examples)

58

Provide cognitive options in the way information
is presented. Prime or activate
background knowledge (advanced
organizers, pre-teaching, analogies)
Highlight critical features, big ideas,
relationships (concept maps,
diagrams, highlighted text)
59
Provide cognitive options in the way information
is presented. Prime or activate
background knowledge (advanced
organizers, pre-teaching, analogies)
Highlight critical features, big ideas,
relationships (concept maps,
diagrams, highlighted text) Embed
scaffolds for using strategies
(prompts, models, graduated scaffolds)

60
Provide cognitive options in the way information
is presented. Prime or activate
background knowledge (advanced
organizers, pre-teaching, analogies)
Highlight critical features, big ideas,
relationships (concept maps,
diagrams, highlighted text) Embed
scaffolds for using strategies
(prompts, models, graduated scaffolds)
Provide supports for memory and transfer
(checklists, mnemonic devices, spaced
review)