Learning Machines and Teaching Machines

1
Learning Machines and Teaching Machines

• Isabelle Guyon
• isabelle_at_clopinet.com

2
Outline

• The need to disseminate our research to the outer
  world
• The means
• The contents
• The team
• The timeline

3
The need

• What to do answer when asked by common people
  whats your job?
• Increase impact
• Cross-fertilize with other disciplines
• Attract new researchers
• Boost our own energy
• Get more funding

4
The idea

• Turn research in Learning into a set of
  pedagogical exhibits.
• Display these exhibits on the Internet, promote
  their use in teaching.
• Turn them into a show, which can be displayed in
  schools and museums.

5
Exhibits

• Wikipedia articles
• Slide shows with voice over
• Videos
• Games/interactive software
• Children/adult activities kitchen counter
  demos.
• Life demonstrations

6
Topics
Survival
Forecasting Decision making
Control
Language
Memory
Creation
7
Challenges

• Challenges are teaching machines!
• Pascal challenges
• Use of challenges in teaching
• Latest on-going challenge

8
NIPS 2006 Feature Selection Challenge

• Five datasets, 75 participants
• Web site (still available)
• Book
• Machine learning toolkit (Spider)
• Class taught http//clopinet.com/isabelle/Project
  s/ETH/

9
NIPS 2006 Datasets
tr/va/te f
Mass-spec 100/ 100/ 700 104
Text 6000/ 1000/ 6500 5000
Drug disco-very 300/ 300/ 2000 2.104
Digits 800/ 350/ 800 105
Artifi-cial 2000/ 600/ 1800 500
10
Student Results
11
Agnostic Learning vs. Prior Knowledge
tr/va/te af/pf
150
Mar-ke-ting 4147/ 415/ 41471 14/ 48
Digits 6000/ 1000/ 31532 784/ 970
Drug disco-very 3845/ 385/ 38449 NA/ 1617
Text 1754/ 175/ 17537 NA/ 16969
Eco-logy 13086/ 1308/ 130858 108/ 216
ADA
100
50
0
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0.5
150
100
GINA
50
0
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0.5
150
100
HIVA
50
0
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0.5
150
100
NOVA
50
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0.5
150
100
SYLVA
50
0
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
0.5
Test BER ()
http//www.agnostic.inf.ethz.ch/
12
The Team

• Coordinator
• Web master
• Scientific exhibition expert
• Idea providers
• Content providers
• Sponsors

13
Timeline

• February 2007 first draft web site call for
  exhibit proposals
• July 2007 Deadline for exhibit proposals
• August 2007 Organizing committee meeting.
• September 2007 Submit proposal to NIPS.
• December 2007 Show exhibit 1st time at NIPS.
• January 2008 start working on pedagogical kit
  scale up exhibition.