R-tfidf, A variety of tf-idf Term Weighting Strategy in Document Categorization
Document Type
Conference Proceeding
Publisher
IEEE
Faculty
Faculty of Computing, Health and Science
School
School of Computer and Security Science
RAS ID
12680
Abstract
Term weighting strategy plays an essential role in the areas related to text processing such as text categorization and information retrieval. In such systems, term frequency, inverse document frequency, and document length normalization are important factors to be considered when a term weighting strategy is developed. Term length normalization is proposed to give equal opportunities to retrieve both lengthy documents and shorter ones. However, terms in very short documents that may be useless for users, especially in the scenario of Web information retrieval, could be assigned very high weights, resulting in a situation where shorter documents are ranked higher than lengthy documents that are more relevant to users information needs. In this research, a new R-tfidf term weighting strategy is proposed to alleviate the side effects of document length normalization. Experimental results demonstrate the proposed approach can to some extent improve the performance of text categorization.
DOI
10.1109/SKG.2011.44
Access Rights
subscription content
Comments
Zhu, D., & Xiao, J. (2011,). R-tfidf, A variety of tf-idf term weighting strategy in document categorization. Paper presented at the International Conference on Semantics, Knowledge, and Grids. Beijing. Available here