Pairwise Learning of Multilabel Classifications with Perceptrons
| Type of publication: | Techreport |
| Citation: | jf:TUD-KE-2007-05 |
| Number: | TUD-KE-2007-05 |
| Year: | 2007 |
| Institution: | TU Darmstadt, Knowledge Engineering Group |
| URL: | /publications/reports/tud-ke-2007-05.pdf |
| Abstract: | Multiclass Multilabel Perceptrons (MMP) are an efficient incremental algorithm for training a team of perceptrons for a multilabel prediction task. The key idea is to train one binary classifier per label, as is typically done for addressing multilabel problems, but to make the training signal dependent on the performance of the whole ensemble. In this paper, we propose an alternative approach that is based on a pairwise approach, i.e., we incrementally train a perceptron for each pair of classes. An evaluation on the Reuters 2000 (RCV1) data shows that our multilabel pairwise perceptron (MLPP) algorithm yields substantial improvements over MMP in terms of ranking quality and overfitting resistance, while maintaining its efficiency. Despite the quadratic increase in the number of perceptrons that have to be trained, the increase in computational complexity is bounded by the average number of labels per training example. |
| Keywords: | |
| Authors | |
|
Attachments
|
|
|
|
|
Topics
|
|
|
|
