Scalingup Cortical Representations

1
Scaling-up Cortical Representations

• David W. McLaughlin
• Courant Institute Center for Neural Science
• New York University
• http//www.cims.nyu.edu/faculty/dmac/
• MSRI -- March 04

2

• In collaboration with
• ? ? David Cai
• Louis Tao
• Michael Shelley
• Aaditya Rangan

3
(No Transcript)
4
Coarse-Grained Asymptotic Representations

• Needed for Scale-up

5
Lateral Connections and Orientation -- Tree
Shrew Bosking, Zhang, Schofield Fitzpatrick J.
Neuroscience, 1997
6
(No Transcript)
7
(No Transcript)
8
(No Transcript)
9
(No Transcript)
10
Coarse-Grained Reductions for V1

• Average firing rate models (Cowan Wilson .
  Shelley McLaughlin)
• m?(x,t), ? E,I

11
But realistic networks have a very noisy dynamics

• Strong temporal fluctuations
• On synaptic timescale
• Fluctuation driven spiking

12
Experiment Observation Fluctuations in
Orientation Tuning (Cat data from Fersters Lab)
Ref Anderson, Lampl, Gillespie, Ferster Science,
1968-72 (2000)
threshold (-65 mV)
13
Fluctuation-driven spiking
(very noisy dynamics, on the synaptic time scale)
Solid average ( over 72
cycles) Dashed 10 temporal trajectories
14

• To accurately and efficiently describe these
  fluctuations, the scale-up method will require
  pdf representations
• ??(v,g x,t), ? E,I
• To benchmark these, we will numerically
  simulate IF neurons within one CG patch

15
Coarse-Grained Reductions for V1

• PDF representations (Knight Sirovich
  Tranchina, Nykamp Haskell Cai, Tao, Shelley
  McLaughlin)
• ??(v,g x,t), ? E,I
• Sub-network of embedded point neurons -- in a
  coarse-grained, dynamical background
• (Cai,Tao McLaughlin)

16
(No Transcript)
17
1 - p Synaptic Failure rate
18
(No Transcript)
19
(No Transcript)
20
(No Transcript)
21
(No Transcript)
22
(No Transcript)
23
Closures
24
(No Transcript)
25
Fluctuation-Driven Dynamics
PDF of v Theory? ?IF
(solid) Fokker-Planck?
Theory? ?IF ?Mean-driven limit (
) Hard thresholding
N75
Experiment
firing rate (Hz)
N75 s5msec S0.05 f0.01
26

• Bistability and Hysteresis
• Network of Simple, Excitatory only

N16!
N16
MeanDriven
FluctuationDriven
Relatively Strong Cortical Coupling
27

• Bistability and Hysteresis
• Network of Simple, Excitatory only

N16!
MeanDriven
Relatively Strong Cortical Coupling
28
Simple Complex Cells Multiple interacting CG
Patches
29
Recall
30
(No Transcript)
31
Simple Complex Cells Multiple interacting CG
Patches
32
(No Transcript)
33
(No Transcript)
34
(No Transcript)
35

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory

36

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Complex Excitatory Cells
• Mean-Driven

37

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Complex Excitatory Cells
• Mean-Driven

38

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Complex Excitatory Cells
• Mean-Driven

39

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Complex Excitatory Cells
• Mean-Driven

40

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Simple Excitatory Cells
• Mean-Driven

41

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Simple Excitatory Cells
• Mean-Driven

42

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Simple Excitatory Cells
• Mean-Driven

43

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Simple Excitatory Cells
• Mean-Driven

44

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Simple Excitatory Cells
• Mean-Driven

45

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Complex Excitatory Cells
• Fluctuation-Driven

46

• Incorporation of Inhibitory Cells
• 4 Population Dynamics
• Simple
• Excitatory
• Inhibitory
• Complex
• Excitatory
• Inhibitory
• Simple Excitatory Cells
• Fluctuation-Driven

47
Three Dynamic Regimes of Cortical
Amplification 1) Weak Cortical
Amplification No Bistability/Hysteresis
2) Near Critical Cortical Amplification
3) Strong Cortical Amplification Bistabili
ty/Hysteresis (2) (1)
(3)
IF Excitatory Complex Cells Shown
(2) (1)
48
Embedded Point Neurons

• Firing rate codes
• Vs
• Spike timing codes

49
(No Transcript)
50
Embedded Point Neurons

• For scale-up computer efficiency
• Yet maintaining firing properties of individual
  neurons -- for spike coding, coincidence
  detection, etc.
• Model relevant for biologically distinguished
  sparse, strong sub-networks perhaps such as
  long-range connections
• Point neurons -- embedded in, and fully
  interacting with, coarse-grained kinetic theory,
• Or, when kinetic theory accurate by itself,
  embedded as test neurons

51
(No Transcript)
52
(No Transcript)
53
IF vs. Embedded Network Spike Rasters
a) IF Network 50 Simple cells, 50 Complex
cells. Simple cells driven at 10 Hz b)-d)
Embedded IF Networks b) 25 Complex cells
replaced by single kinetic equation c) 25
Simple cells replaced by single kinetic
equation d) 25 Simple and 25 Complex cells
replaced by kinetic equations. In all panels,
cells 1-50 are Simple and cells 51-100 are
Complex. Rasters shown for 5 stimulus periods.
54
(No Transcript)
55
IF vs. Embedded Network Spike Rasters
a) IF Network 40 Simple cells, 40 Complex
cells. Simple cells driven at 10 Hz b)-d)
Embedded IF Networks b) 20 Complex cells
replaced by log-form rate equation c) 20
Simple cells replaced by log-form rate
equation d) 20 Simple and 20 Complex cells
replaced by log-form rate equations. In all
panels, cells 1-40 are Simple and cells 41-80
are Complex. Rasters shown for 5 stimulus
periods.
56
a) IF Network 50 Simple cells, 50
Complexcells. Simplecells driven at 10 Hz b)
Embedded IF Networks, with Complex IF neurons
receiving input but not outputing to the network.
25 Complexcells replaced by kinetic equations.
In all panels, cells 1-50 are Simple and cells
51-75 are Complex. Rasters shown for 5 stimulus
periods.
57
Dynamic Firing Rates (Shown Exc Simple Pop in
a 4 Pop Model) Forcing--time-dependent Poisson
process, sinusoidal driving at 10 Hz. In the
embedded models, excitatory neurons are IF and
inhibitory neurons are replaced by Kinetic
Theory.
58
The Importance of Fluctuations
Cycle-averaged Firing Rate Curves Shown Exc
Cmplx Pop in a 4 population model) Full IF
network (solid) , Full IF KT (dotted) Full
IF coupled to Full KT but with mean only
coupling (dashed). In both embedded cases
(where the IF units are coupled to KT), half
the simple cells are represented by Kinetic Theory
59
Steady State Firing Rate Curves (for the
excitatory population) IF, Exc. Inh.
(Magenta), Kinetic Theory, Exc. Inh. (Red),
Embedded Network (Blue), Log-form (Green). In
the Embedded model, Excitatory neurons are IF
and Inhibitory neurons are modelled by Kinetic
Theory.
60
Steady State Firing Rate Curves for Embedded
Sub-networks (Shown, Exc Cmplx Pop) In the
embedded models, half of the simple cells are
replaced by Kinetic Theory. However, in the IF
KT (mean only) , they are coupled back to the
IF neurons as mean conductance drives.
61
(From left to right) Rasters, Cross-correlation
and ISI distributions for two simulations (Upper
panels) Kinetic Theory of a neuronal patch
driving test neurons, which are not coupled to
each other (Lower panels) KT of a neuronal patch
driving strongly coupled neurons. In both cases,
the CGed patch is being driven at 1 Hz. Neurons
1-6 are excitatory Neurons 7-8 are inhibitory
the S-matrix is (See, Sei, Sie, Sii) (0.3, 0.4,
0.6, 0.4). EPSP time constant 3 ms IPSP time
constant 10 ms.
62
(From left to right) Rasters, Cross-correlation
and ISI distributions for two simulations (Upper
panels) Kinetic Theory of a neuronal patch
driving test neurons, which are not coupled to
each other (Lower panels) KT of a neuronal patch
driving strongly coupled neurons. In both cases,
the CGed patch is being driven asynchronously,
and are firing at a fixed rate. IF Neurons 1-6
are excitatory Neurons 7-8 are inhibitory the
S-matrix is (See, Sei, Sie, Sii) (0.4, 0.4,
0.8, 0.4). EPSP time constant 3 ms IPSP time
constant 10 ms.
63
Embedded Network
Full I F Network
Raster Plots, Cross-correlation and ISI
distributions. (Upper panels) KT of a
neuronal patch with strongly coupled embedded
neurons (Lower panels) Full IF Network.
Shown is the sub-network, with neurons 1-6
excitatory neurons 7-8 inhibitory EPSP time
constant 3 ms IPSP time constant 10 ms.
64
Test neuron within a CG Kinetic Theory
ISI distributions for two simulations (Left)
Test Neuron driven by a CG neuronal patch
(Right) Sample Neuron in the IF Network.
65
Reverse Time Correlations

• Correlates spikes against driving signal
• Triggered by spiking neuron
• Frequently used experimental technique to get a
  handle on one description of the system
• P(?,?) probability of a grating of orientation
  ?, at a time ? before a spike
• -- or an estimate of the systems linear
  response kernel as a function of (?,?)

66

• Reverse-Time Correlation (RTC)
• System analysis
• Probing network dynamics

Time ?
67
Reverse Correlation
Left IF Network of 128 Simple and 128
Complex cells at pinwheel center. RTC P(???)
for single Simple cell. Below Embedded Network
of 128 Simple cells, with 128 Complex cells
replaced by single kinetic equation. RTC P(???)
for single Simple cell.
68
Computational Efficiency

• For statistical accuracy in these CG patch
  settings, Kinetic Theory is 103 -- 105 more
  efficient than IF
• The efficiency of the embedded sub-network scales
  as N2, where N of embedded point neurons
• (i.e. 100 ? 20 yields 10,000 ?400)

69
Conclusions

• Kinetic Theory is a numerically efficient, and
  remarkably accurate, method for scale-up.
• Kinetic Theory introduces no new free parameters
  into the model, and has a large dynamic range
  from the rapid firing mean-driven regime to a
  fluctuation driven regime.
• Kinetic Theory does not capture detailed
  spike-timing
• Sub-networks of point neurons can be embedded
  within kinetic theory to capture spike timing,
  with a range from test neurons to fully
  interacting sub-networks.

70
(No Transcript)
71
(No Transcript)
72
Conclusions and Directions

• Constructing ideal network models to discern and
  extract possible principles of neuronal
  computation and functions
• Mathematical methods for analytical
  understanding
• Search for signatures of identified mechanisms
• Mean-driven vs. fluctuation-driven kinetic
  theories
• New closure, Fluctuation and correlation effects
• Excellent agreement with the full numerical
  simulations
• Large-scale numerical simulations of structured
  networks constrained by anatomy and other
  physiological observations to compare with
  experiments
• Structural understanding vs. data modeling
• New numerical methods for scale-up --- Kinetic
  theory

73

• Three Dynamic Regimes of Cortical
  Amplification
• 1) Weak Cortical Amplification
• No Bistability/Hysteresis
• 2) Near Critical Cortical Amplification
• 3) Strong Cortical Amplification
• Bistability/Hysteresis
• (2) (1)
• (3)
• IF
• Excitatory Cells Shown
• Possible Mechanism
• for Orientation Tuning of Complex Cells
• Regime 2 for far-field/well-tuned Complex Cells
• Regime 1 for near-pinwheel/less-tuned

(2) (1)
74
FluctuationDriven Tuning Dynamics Near
Critical Amplification vs. Weak Cortical
Amplification Sensitivity to Contrast
Ring Model A less-tuned complex
cell Ring Model far field A well-tuned
complex cell Large V1 Model A complex
cell in the far-field
Ring Model of Orientation Tuning Near
Pinwheel Far Field
A Cell in Large V1 Model
75
Summary Conclusion
76
Summary Points for Coarse-Grained Reductions
needed for Scale-up

• Neuronal networks are very noisy, with
  fluctuation driven effects.
• Temporal scale-separation emerges from network
  activity.
• Local temporal asynchony needed for the
  asymptotic reduction, and it results from
  synaptic failure.
• Cortical maps -- both spatially regular and
  spatially random -- tile the cortex asymptotic
  reductions must handle both.
• Embedded neuron representations may be needed to
  capture spike-timing codes and coincidence
  detection.
• PDF representations may be needed to capture
  synchronized fluctuations.

77
Scale-up Dynamical Issuesfor Cortical Modeling
of V1

• Temporal emergence of visual perception
• Role of spatial temporal feedback -- within and
  between cortical layers and regions
• Synchrony asynchrony
• Presence (or absence) and role of oscillations
• Spike-timing vs firing rate codes
• Very noisy, fluctuation driven system
• Emergence of an activity dependent, separation of
  time scales
• But often no (or little) temporal scale
  separation

78
(No Transcript)
79
(No Transcript)
80
Closures
81
(No Transcript)
82
(No Transcript)
83
(No Transcript)
84
(No Transcript)
85
(No Transcript)
86
(No Transcript)
87
(No Transcript)
88
Kinetic Theory for Population Dynamics
Population of interacting neurons
1-p Synaptic Failure rate
89
Under ASSUMPTIONS 1) 2) Summed
intra-cortical low rate spike events become
Poisson
Kinetic Equation
90
Fluctuation-Driven Dynamics Physical Intuition
Fluctuation-driven/Correlation between g and V
Hierarchy of Conditional Moments
91
Closure Assumptions
Closed Equations Reduced Kinetic Equations
92
Coarse-Graining in Time

• Fluctuation Effects
• Correlation Effects

Fokker-Planck Equation
Flux Determination of Firing Rate For a
steady state, m can be determined implicitly
93
(No Transcript)