• DocumentCode
    3545549
  • Title

    Exploiting Non-Parallel Corpora for Statistical Machine Translation

  • Author

    Cuong Hoang ; Le Anh Cuong ; Nguyen Phuong Thai ; Ho Tu Bao

  • Author_Institution
    Univ. of Eng. & Technol., Hanoi, Vietnam
  • fYear
    2012
  • fDate
    Feb. 27 2012-March 1 2012
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    Constructing a corpus of parallel sentence pairs is an important work in building a Statistical Machine Translation system. It impacts deeply how the quality of a Statistical Machine Translation could achieve. The more parallel sentence pairs we use to train the system, the better translation\´s quality it is. Nowadays, comparable non-parallel corpora become important resources to alleviate scarcity of parallel corpora. The problem here is how to extract parallel sentence pairs automatically but accurately from comparable non-parallel corpora, which are usually very "noisy". This paper presents how we can apply the reinforcement-learning scheme with our new proposed algorithm for detecting parallel sentence pairs. We specify that from an initial set of parallel sentences in a domain, the proposed model can extract a large number of new parallel sentence pairs from non-parallel corpora resources in different domains, concurrently increasing the system\´s translation ability gradually.
  • Keywords
    language translation; learning (artificial intelligence); nonparallel corpora; parallel sentence pair detection; reinforcement learning scheme; statistical machine translation system; Electronic publishing; Encyclopedias; Error analysis; Internet; Length measurement; Training;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Computing and Communication Technologies, Research, Innovation, and Vision for the Future (RIVF), 2012 IEEE RIVF International Conference on
  • Conference_Location
    Ho Chi Minh City
  • Print_ISBN
    978-1-4673-0307-1
  • Type

    conf

  • DOI
    10.1109/rivf.2012.6169833
  • Filename
    6169833