Title :
A weighted algorithm of inductive transfer learning based on maximum entropy model
Author :
Zhang, Yuhong ; Hu, Xuegang ; Mei, Canhua ; Li, Peipei
Author_Institution :
Dept. of Comput. Sci. & Technol., Hefei Univ. of Technol., Hefei, China
Abstract :
Traditional machine learning and data mining algorithms mainly assume that the training and test data must be in the same feature space and follow the same distribution. However, in real applications, these two hypotheses are difficult to hold, traditional algorithms are hence no longer applicable. As a new framework of learning, transfer learning could solve this problem effectively. This paper focuses on one of important branches in this field, namely inductive transfer learning. Correspondingly, a weighted algorithm of inductive transfer learning, based on maximum entropy model, is proposed, called WTLME. It transfers the model parameters learned from the source domain to the target domain, and meanwhile adjusts the weights of instances in the target domain to obtain the model with high accuracy. Extensive studies demonstrate that our proposed algorithm of WTLME is more effective and efficient than traditional algorithms that require learning from scratch if the data distributions change. Moreover, WTLME is comparable to the previous transfer algorithm based on maximum entropy model.
Keywords :
data mining; learning (artificial intelligence); maximum entropy methods; WTLME; data mining algorithms; inductive transfer learning; machine learning algorithms; maximum entropy model; source domain; target domain; weighted algorithm; Adaptation model; Classification algorithms; Data models; Entropy; Error analysis; Machine learning; Machine learning algorithms; data mining; machine learning; maximum entropy; transfer learning;
Conference_Titel :
Fuzzy Systems and Knowledge Discovery (FSKD), 2010 Seventh International Conference on
Conference_Location :
Yantai, Shandong
Print_ISBN :
978-1-4244-5931-5
DOI :
10.1109/FSKD.2010.5569513