• DocumentCode
    2885170
  • Title

    Similarity Computation of Chinese Question Based on Chunk

  • Author

    Yu, Zheng-tao ; Hu, Lei ; Huang, Li ; Deng, Jing-hui ; Tang, Shi Ping

  • Author_Institution
    Sch. of Inf. Eng. & Autom., Kunming Univ. of Sci. & Technol.
  • fYear
    2006
  • fDate
    13-16 Aug. 2006
  • Firstpage
    17
  • Lastpage
    22
  • Abstract
    The currently similarity computation methods of Chinese sentence and their shortcomings are analyzed at first. According to the characteristic of the Chinese question sentence, Chinese question general chunk and special chunk are defined, and then a similarity computation method of Chinese question based on chunk is proposed. In this method, the semantic similarity of words is computed on the basis of HowNet. General chunk is recognized by chunk parsing theory and HMM learning method, and special chunk is retrieved with some heuristic rule or SVM learning methods, then the similarity of each chunk in the two question sentences is computed separately, then the similarity computation of question sentence is realized, which is based on chunk similarity. Finally, the experiment result of question similarity computation method shows that the method proposed in the paper gets a better performance than the others
  • Keywords
    computational linguistics; grammars; hidden Markov models; information retrieval; natural languages; support vector machines; text analysis; Chinese question sentence; HMM learning method; HowNet; SVM learning methods; chunk parsing theory; similarity computation methods; word semantic similarity; Application software; Automation; Computational modeling; Computer applications; Computer science; Cybernetics; Data mining; Hidden Markov models; Information analysis; Laboratories; Learning systems; Machine learning; Support vector machines; Tagging; Chunk similarity; Sentence similarity; general chunk; special chunk; word similarity;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Machine Learning and Cybernetics, 2006 International Conference on
  • Conference_Location
    Dalian, China
  • Print_ISBN
    1-4244-0061-9
  • Type

    conf

  • DOI
    10.1109/ICMLC.2006.258809
  • Filename
    4028026