• DocumentCode
    2917463
  • Title

    Using NMF-based text summarization to improve supervised and unsupervised classification

  • Author

    Tsarev, Dmitry ; Petrovskiy, Mikhail ; Mashechkin, Igor

  • Author_Institution
    Comput. Sci. Dept., Lomonosov Moscow State Univ., Moscow, Russia
  • fYear
    2011
  • fDate
    5-8 Dec. 2011
  • Firstpage
    185
  • Lastpage
    189
  • Abstract
    This paper presents a new generic text summarization method using Non-negative Matrix Factorization (NMF) to estimate sentence relevance. Proposed sentence relevance estimation is based on normalization of NMF topic space and further weighting of each topic using sentences representation in topic space. The proposed method shows better summarization quality and performance than state of the art methods on DUC 2002 standard dataset. In addition, we study how this method can improve the performance of supervised and unsupervised text classification tasks. In our experiments with Reuters-21578 and Classic4 benchmark datasets we apply developed text summarization method as a preprocessing step for further multi-label classification and clustering. As a result, the quality of classification and clustering has been significantly improved.
  • Keywords
    matrix decomposition; pattern classification; pattern clustering; text analysis; Classic4; NMF based text summarization; Reuters-21578; multilabel classification; multilabel clustering; nonnegative matrix factorization; sentence relevance estimation; sentences representation; supervised classification; unsupervised classification; Benchmark testing; Clustering algorithms; Hybrid intelligent systems; Matrix decomposition; Semantics; Training; Vectors; clustering; generic text summarization; latent semantic analysis; multi-label classification; non-negative matrix factorization;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Hybrid Intelligent Systems (HIS), 2011 11th International Conference on
  • Conference_Location
    Melacca
  • Print_ISBN
    978-1-4577-2151-9
  • Type

    conf

  • DOI
    10.1109/HIS.2011.6122102
  • Filename
    6122102