Selective Multi-Task Learning by Coupling Common and Private Representations

1
Selective Multi-Task Learning by Coupling Common
and Private Representations
Jaisiel Madrid-Sánchez, Emilio Parrado-Hernández,
Aníbal R. Figueiras Vidal

• Selective knowledge transfer among tasks when
  degree of relatedness varies.

we express it by varying the contribution
of common and private representations (given by
coupling parameter )
2 scenarios under NNs
Selective MLP-MTL (vs. Caruanas scheme)
Selective SLP-MTL (first SLP-MTL)

• large

STL

• small

Same internal features ( )
Same final model ( )
different notion of task relatedness
2
Selective Multi-Task Learning by Coupling Common
and Private Representations

• Experiments

Internal feature selection

• allows to switch between STL and classic MTL.