C-BiLDA extracting cross-lingual topics from non-parallel texts by distinguishing shared from unshared content
Data Min. Knowl. Discov.(2015)
摘要
We study the problem of extracting cross-lingual topics from non-parallel multilingual text datasets with partially overlapping thematic content (e.g., aligned Wikipedia articles in two different languages). To this end, we develop a new bilingual probabilistic topic model called comparable bilingual latent Dirichlet allocation (C-BiLDA), which is able to deal with such comparable data, and, unlike the standard bilingual LDA model (BiLDA), does not assume the availability of document pairs with identical topic distributions. We present a full overview of C-BiLDA, and show its utility in the task of cross-lingual knowledge transfer for multi-class document classification on two benchmarking datasets for three language pairs. The proposed model outperforms the baseline LDA model, as well as the standard BiLDA model and two standard low-rank approximation methods (CL-LSI and CL-KCCA) used in previous work on this task.
更多查看译文
关键词
Cross-lingual text mining,Multilingual topic modeling,Multilinguality,Comparable data,Cross-lingual knowledge transfer,Unsupervised modeling of text data,Representation learning
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络