PowerPoint-Pr

1
Perception-action mediation in music
Stefan Koelsch
Perception of Musical Sounds _at_ University of
Sussex
2
Common Coding
Prinz, European Journal of Cognitive Psychology,
1997
3
motor theory of speech perception

• (perception of) speech is decoded by the same
  processes that are involved in speech production
  (Liberman Mattingly, 1985)

4
Koelsch Siebel, TICS, 2005
5
mirror neuron
The experimenter grasps a piece of food with his
hand then moves it toward the monkey, who, at the
end of the trial, grasps it. The neuron
discharges during observation of the grip, ceases
to fire when the food is given to the monkey and
discharges again when the monkey grasps
it. Adapted from Rizzolatti et al. (1996) Cogn.
Brain Res. 3, 131141
6
Perception action mediation in pianists
Haueisen Knoesche, JOCN 2001
7
Perception action mediation in pianists
Haueisen Knoesche, JOCN 2001
8
PM neurons responding to sounds
Example of a neuron that discharges when the
monkey performs a hand action (not shown). This
neuron also responded to the vision and sound of
a tearing action (paper ripping VS). Simply
hearing the sound of the same action (performed
out of the monkeys sight) was equally effective
(S). Sounds that were nonaction-related (white
noise, monkey calls) did not evoke any excitatory
response (CS1, CS2). Rastergrams are shown
together with spike density functions. Vertical
lines indicate the time when the sound occurred.
Traces under the spike density functions in S and
in CS conditions are oscillograms of the sounds
used to test the neurons. Kohler E, et al.,
Science 2002
9
Perception action mediation in nonmusicians
Callan et al., NeuroImage 2006
10
Perception action mediation in nonmusicians
Callan et al., NeuroImage 2006
11
Training of perception action mediation with
music
Lahav, Saltzman Schlaug, J Neurosci 2007
12
perception action mediation and emotion
Koelsch, Fritz Mueller, et al Human Brain
Mapping 2006
13
Perception action (mirror) mechanisms serve
...

• The understanding of actions
• The learning of actions
• Prediction of actions of others

14
Premotor codes are also used for Working memory
Koelsch, Schulze, Sammler, et al., Human Brain
Mapp, in press