Image Classification by Cross-Media Active Learning with Privileged Information

Publication Type:
Journal Article
IEEE Transactions on Multimedia, 2016, 18 (12), pp. 2494 - 2502
Issue Date:
Filename Description Size
i.pdfPublished Version742.06 kB
Adobe PDF
Full metadata record
© 2016 IEEE. In this paper, we propose a novel cross-media active learning algorithm to reduce the effort on labeling images for training. The Internet images are often associated with rich textual descriptions. Even though such textual information is not available in test images, it is still useful for learning robust classifiers. In light of this, we apply the recently proposed supervised learning paradigm, learning using privileged information, to the active learning task. Specifically, we train classifiers on both visual features and privileged information, and measure the uncertainty of unlabeled data by exploiting the learned classifiers and slacking function. Then, we propose to select unlabeled samples by jointly measuring the cross-media uncertainty and the visual diversity. Our method automatically learns the optimal tradeoff parameter between the two measurements, which in turn makes our algorithms particularly suitable for real-world applications. Extensive experiments demonstrate the effectiveness of our approach.
Please use this identifier to cite or link to this item: