News topic detection based on hierarchical clustering and named entity

Publisher:
IEEE
Publication Type:
Conference Proceeding
Citation:
2011 7th International Conference on Natural Language Processing and Knowledge Engineering (NLP-KE), 2011, pp. 280 - 284
Issue Date:
2011-11-27
Full metadata record
Files in This Item:
Filename Description Size
06138209.pdfPublished version361.43 kB
Adobe PDF
News topic detection is the process of organizing news story collections and real-time news/broadcast streams into news topics. While unlike the traditional text analysis, it is a process of incremental clustering, and generally divided into retrospective topic detection and online topic detection. This paper considers the feature changes of modern news data experienced from the past, and presents a new topic detection strategy based on hierarchical clustering and named entities. Topic detection process is also divided into retrospective and online steps, and named entities in the news stories are employed in the topic clustering algorithm. For the online step's efficiency and precision, this paper first clusters news stories in each time window into micro-clusters, and then extracts three representation vectors for each micro-cluster to calculate the similarity to existing topics. The experimental results show remarkable improvement compared with recently most applied topic detection method.
Please use this identifier to cite or link to this item: