The improvement of LDA: Considering avoiding repetition

Topic models are increasingly studied in summarization and other application of discrete data. Though latent Dirichlet allocation (LDA) is one of the widely-used topic models for textual and image data, its Dirichlet distribution does not capture correlations between topics very well. To overcome the drawback, directed acyclic graph (DAG) and other algebra distribution, such as logistic normal distribution, were used to describe the correlations between topics. They are effective but relatively expensive. Avoiding repetition is a regular rule in English document, which was ignored in previous related works. We proposed a less expensive amend LDA model considering the avoiding repetition as a kind of topic correlations. We introduced the principium and concept of amend model based on related basic works at first. Then we describe the additive functions in details. We report the result of the adjusted model in ad hoc IR experiment, which showed that the amend model outperform the basic LDA model. Finally, the influence of some model parameters was analysis briefly.