An online HDP-HMM for joint action segmentation and classification in motion capture data

Publication Type:
Conference Proceeding
IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2012, pp. 1 - 7
Issue Date:
Full metadata record
Files in This Item:
Filename Description Size
Thumbnail2012001312OK.pdf Published version519.31 kB
Adobe PDF
Since its inception, action recognition research has mainly focused on recognizing actions from closed, predefined sets of classes. Conversely, the problem of recognizing actions from open, possibly incremental sets of classes is still largely unexplored. In this paper, we propose a novel online method based on the "sticky" hierarchical Dirichlet process and the hidden Markov model [11, 5]. This approach, labelled as the online HDP-HMM, provides joint segmentation and classification of actions while a) processing the data in an online, recursive manner, b) discovering new classes as they occur, and c) adjusting its parameters over the streaming data. In a set of experiments, we have applied the online HDP-HMM to recognize actions from motion capture data from the TUM kitchen dataset, a challenging dataset of manipulation actions in a kitchen [12]. The results show significant accuracy in action classification, time segmentation and determination of the number of action classes. © 2012 IEEE.
Please use this identifier to cite or link to this item: