DSP-CIS Chapter-8: Introduction to Optimal

1
DSP-CISChapter-8 Introduction to Optimal
Adaptive Filters

• Marc Moonen
• Dept. E.E./ESAT, KU Leuven
• marc.moonen_at_esat.kuleuven.be
• www.esat.kuleuven.be/scd/

2
Optimal Adaptive Filters

• Introduction
• Optimal Adaptive Filters
• Applications
• Optimal/Wiener Filters and least squares
  estimation
• Recursive Least Squares (RLS) Estimation
• Least Means Squares (LMS) Algorithm
• Other

3
Optimal Adaptive Filters - Intro
4
Optimal Adaptive Filters - Intro
5
Optimal Adaptive Filters - Intro
6
Optimal Adaptive Filters - Intro
7
Optimal Adaptive Filters - Intro
8
Optimal Adaptive Filters - Intro
9
Optimal Adaptive Filters - Intro
echo path
near-end signal
near-end signal echo
10
Optimal Adaptive Filters - Intro
11
Optimal Adaptive Filters - Intro
12
Optimal Adaptive Filters - Intro
13
Optimal Adaptive Filters - Intro
noise
signal noise
14
Optimal Adaptive Filters - Intro
15
Optimal Adaptive Filters - Intro
16
Optimal Adaptive Filters - Intro
17
Optimal Adaptive Filters - Intro
18
Optimal Adaptive Filters - Intro
19
Optimal Adaptive Filters - Intro
20
Optimal Adaptive Filters - Intro
21
Optimal Adaptive Filters - Intro
22
Optimal Adaptive Filters - Intro
23
Least Squares RLS Estimation
2
24
Least Squares RLS Estimation
3
2
25
Least Squares RLS Estimation
3
2
26
Least Squares RLS Estimation
3
2
27
Least Squares RLS Estimation
3
28
Least Squares RLS Estimation
3
29
Least Squares RLS Estimation
3
30
Least Squares RLS Estimation
3
31
Least Squares RLS Estimation
3
32
4. Least Mean Squares (LMS) Algorithm
Bernard Widrow
33
Least Mean Squares (LMS) Algorithm
4
34
Least Mean Squares (LMS) Algorithm
4
(Widrow 1965 !!)
35
Least Mean Squares (LMS) Algorithm
4
36
Least Mean Squares (LMS) Algorithm
4
37
Least Mean Squares (LMS) Algorithm
4
38
Least Mean Squares (LMS) Algorithm
4
39
5. Other Square-root RLS Algorithms
40
5. Other Fast RLS Algorithms