Short Texts Classification Through Reference Document Expansion

作     者：YANG Zhen FAN Kefeng LAI Yingxu GAO Kaiming WANG Yong 

作者机构：College of Computer Science Beijing University of Technology China Electronics Standardization Institute CSIP Guangxi Section Guilin University of Electronic Technology 

出 版 物：《Chinese Journal of Electronics》 (电子学报(英文))

年 卷 期：2014年第23卷第2期

页      面：315-321页

核心收录：

学科分类：0808[工学-电气工程] 0809[工学-电子科学与技术（可授工学、理学学位）] 081203[工学-计算机应用技术] 08[工学] 0835[工学-软件工程] 0701[理学-数学] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：supported by the National Natural Science Foundation of China(No.61001178,No.61172053,No.61202266) National Soft Science Research Program(No.2010GXQ5D317) Beijing Natural Science Foundation(No.4102012,No.4112009) Scientific Research Common Program of Beijing Municipal Commission of Education(No.KM201210005024) the National High Technology Research and Development Program of China(863 Program)(No.2012AA011706) 

主　　题：Text classification Short texts Language model Document expansion External reference 

摘      要：With the rapid development of information technology, short texts arising from socialized human interaction are gradually predominant in network information streams. Accelerating demands are requiring the industry to provide more effective classification of the brief ***, faced with short text documents, each of which contains only a few words, traditional document classification models run into difficulty. Aggressive documents expansion works remarkably well for many cases but suffers from the assumption of independent, identically distributed observations. We formalize a view of classification using Bayesian decision theory, treat each short text as observations from a probabilistic model, called a statistical language model, and encode classification preferences with a loss function defined by the language models and the external reference document. According to Vapnik’s methods of Structural risk minimization(SRM), the optimal classification action is the one that minimizes the structural risk, which provides a result that allows one to trade off errors on the training sample against improved generalization performance. We conduct experiments by using several corpora of microblog-like data, and analyze the experimental results. With respect to established baselines,results of these experiments show that applying our proposed document expansion method produces better chance to achieve the improved classification performance.