Chap 8: Adaptive Networks

1
Chap 8 Adaptive Networks
Neural Networks
2
Neural Networks

• Supervised Learning
• Multilayer perceptrons
• Radial basis function networks
• Modular neural networks
• LVQ (learning vector quantization)
• Unsupervised Learning
• Competitive learning networks
• Kohonen self-organizing networks
• ART (adaptive resonant theory)
• Others
• Hopfield networks

3
Adaptive Networks
x
z
y

• Architecture
• Feedforward networks with diff. node functions
• Squares nodes with parameters
• Circles nodes without parameters
• Goal
• To achieve an I/O mapping specified by training
  data
• Basic training method
• Backpropagation or steepest descent

4
Single-Layer Perceptrons

• Network architecture

x1
w1
w0
w2
x2
y signum(Swi xi w0)
w3
x3
5
Single-Layer Perceptrons

• Example Gender classification