DocumentCode
1076709
Title
A Cascaded Approach to Mention Detection and Chaining in Arabic
Author
Zitouni, Imed ; Luo, Xiaoqiang ; Florian, Radu
Author_Institution
IBM T. J. Watson Res. Center, Yorktown Heights, NY
Volume
17
Issue
5
fYear
2009
fDate
7/1/2009 12:00:00 AM
Firstpage
935
Lastpage
944
Abstract
This paper presents a fully statistical approach to Arabic mention detection and chaining system, built around the maximum entropy principle. The presented system takes a cascade approach to processing an input document, by first detecting mentions in the document and then chaining the identified mentions into entities. Both system components use a common maximum entropy framework, which allows the integration of a large array of feature types, including lexical, morphological, syntactic, and semantic features. Arabic offers additional challenges for this task (when compared with English, for example), as segmentation is a needed processing step, so one can correctly identify and resolve enclitic pronouns. The system presented has obtained very competitive performance in the automatic content extraction (ACE) evaluation program.
Keywords
maximum entropy methods; natural language processing; statistical analysis; text analysis; Arabic mention detection; automatic content extraction; cascade approach; chaining system; enclitic pronouns; lexical features; maximum entropy principle; segmentation; Cities and towns; Computational linguistics; Data mining; Entropy; Helium; Information retrieval; Morphology; Natural languages; Speech processing; Text processing; Arabic text processing; coreference resolution; maximum entropy; mention detection;
fLanguage
English
Journal_Title
Audio, Speech, and Language Processing, IEEE Transactions on
Publisher
ieee
ISSN
1558-7916
Type
jour
DOI
10.1109/TASL.2009.2016732
Filename
5075775
Link To Document