Feature Relationships Hypergraph for Multimodal Recognition

Publisher:
Springer-Verlag Berlin / Heidelberg
Publication Type:
Conference Proceeding
Citation:
Lecture Notes in Computer Science. Neural Information Processing. 18th International Conference, ICONIP 2011, 2011, pp. 589 - 598
Issue Date:
2011-01
Full metadata record
Files in This Item:
Filename Description Size
Thumbnail2011001853OK.pdf442.47 kB
Adobe PDF
Utilizing multimodal features to describe multimedia data is a natural way for accurate pattern recognition. However, how to deal with the complex relationships caused by the tremendous multimodal features and the curse of dimensionality are still two crucial challenges. To solve the two problems, a new multimodal features integration method is proposed. Firstly, a so-called Feature Relationships Hypergraph (FRH) is proposed to model the high-order correlations among the multimodal features. Then, based on FRH, the multimodal features are clustered into a set of low-dimensional partitions. And two types of matrices, the interpartition matrix and intra-partition matrix, are computed to quantify the inter- and intra- partition relationships. Finally, a multi-class boosting strategy is developed to obtain a strong classifier by combining the weak classifiers learned from the intra- partition matrices. The experimental results on different datasets validate the effectiveness of our approach
Please use this identifier to cite or link to this item: