Lexical semantic based Bayesian model for adaptive wrapper generation

This paper focuses on an unsupervised information extraction system. Two kinds of features related to the text fragments from the Web documents are investigated. The first type of feature is called, a site-invariant feature. The second type of feature is called a site-dependent feature. Feature selection algorithm is used for wrapper generation from the site invariant and site-dependent information. The wrapper is generated and the new attribute is also discovered and adapted with wrapper by using the Bayesian learning method and E-M algorithm along with the lexical semantics search method. Our wrapper can be able to adapt with the new unseen sites. Our system efficiency is evaluated based on some performance measures and the effectiveness of the system is evaluated by using the performance metrics, precision, recall, f-measure, true positive and false positive in the real time web sites.