Exploiting ontology for retrieving data behind searchable web forms

With the virtually unlimited amount of information sources, search engines cannot find or index a large part of these information because they are located behind HTML forms. That part of Web are usually known as hidden Web or deep Web and because the traditional crawlers lack the suitable technique to past HTML forms, many hidden Web crawlers try to beat the problem of retrieving data behind forms. This paper addresses the challenges of form processing and response analysis, through introducing a new technique for automatically fill the searchable forms with using the suitable ontology, then automatically generate and submit the queries and finally analyze the response pages. This technique enhances the performance of hidden Web crawlers in terms of precision, recall, time and cost. By experimenting the proposed technique over the real Web, the results was very promising.