DocumentCode
2270008
Title
Chinese Unknown Word Recognition Based on Functional Applications of Type Theory
Author
Gao, Dongping ; Niu, Zhendong ; Lv, Lening ; Jiang, Peng ; Qin, Xiao ; Guo, Jiahong
Author_Institution
Sch. of Comput. Sci. & Technol., Beijing Inst. of Technol., Beijing
Volume
3
fYear
2008
fDate
20-22 Dec. 2008
Firstpage
498
Lastpage
502
Abstract
We introduce a method based on type functional applications for unknown word recognition in Chinese texts. A major advantage of the method is that it has an ability to detect unknown words of unrestricted characters by calculating the results of type functional applications. The method is built upon the basic type theory. It can take more semantic information while analyzing sentential syntactic structures in this method. In our approach, each word is assigned a type. By type functional applications, union algorithm and type-revivification; we can get the right segmentations of unknown words. It was applied to a newspaper of people daily, achieving 89.96% recall for person names, 77.94% recall for place names and more than 73% recall for other unknown words.
Keywords
character recognition; computational linguistics; natural languages; text analysis; type theory; Chinese unknown word recognition; semantic information; sentential syntactic structures; type functional applications; type-revivification; union algorithm; Application software; Cities and towns; Computer science; Information analysis; Information technology; Sociology; Statistical analysis; Tagging; Text recognition; White spaces; Chinese Segmentations; Functional Applications; Type Theory; Unknown Word Recognition;
fLanguage
English
Publisher
ieee
Conference_Titel
Intelligent Information Technology Application, 2008. IITA '08. Second International Symposium on
Conference_Location
Shanghai
Print_ISBN
978-0-7695-3497-8
Type
conf
DOI
10.1109/IITA.2008.378
Filename
4740047
Link To Document