• DocumentCode
    1076709
  • Title

    A Cascaded Approach to Mention Detection and Chaining in Arabic

  • Author

    Zitouni, Imed ; Luo, Xiaoqiang ; Florian, Radu

  • Author_Institution
    IBM T. J. Watson Res. Center, Yorktown Heights, NY
  • Volume
    17
  • Issue
    5
  • fYear
    2009
  • fDate
    7/1/2009 12:00:00 AM
  • Firstpage
    935
  • Lastpage
    944
  • Abstract
    This paper presents a fully statistical approach to Arabic mention detection and chaining system, built around the maximum entropy principle. The presented system takes a cascade approach to processing an input document, by first detecting mentions in the document and then chaining the identified mentions into entities. Both system components use a common maximum entropy framework, which allows the integration of a large array of feature types, including lexical, morphological, syntactic, and semantic features. Arabic offers additional challenges for this task (when compared with English, for example), as segmentation is a needed processing step, so one can correctly identify and resolve enclitic pronouns. The system presented has obtained very competitive performance in the automatic content extraction (ACE) evaluation program.
  • Keywords
    maximum entropy methods; natural language processing; statistical analysis; text analysis; Arabic mention detection; automatic content extraction; cascade approach; chaining system; enclitic pronouns; lexical features; maximum entropy principle; segmentation; Cities and towns; Computational linguistics; Data mining; Entropy; Helium; Information retrieval; Morphology; Natural languages; Speech processing; Text processing; Arabic text processing; coreference resolution; maximum entropy; mention detection;
  • fLanguage
    English
  • Journal_Title
    Audio, Speech, and Language Processing, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1558-7916
  • Type

    jour

  • DOI
    10.1109/TASL.2009.2016732
  • Filename
    5075775