Chap 9: Supervised Learning Neural Networks

1
Chap 9 Supervised Learning Neural Networks
Neural Networks
2
Multilayer Perceptrons (MLPs)

• Learning rule
• Steepest descent (Backprop)
• Conjugate gradient method
• All optim. methods using first derivative
• Derivative-free optim.

3
Multilayer Perceptrons (MLPs)
Example XOR problem
Training data
x1 x2 y 0 0 0 0 1 1 1 0 1 1
1 0
4
MLP Decision Boundaries