A research of dynamic theme crawler based on keywords and support vector machine

With the rapid development of Internet technology, the limited ability of search engines is difficult to process the increasingly mass data. How to obtain the useful target information from the internet in a short time has become a difficult problem currently. The search results by using general search engines are inaccuracy and the relationship with the search them is not very strong. The theme crawler can focus on a single field, but cannot be applied to other fields. According to introducing the keywords and support vector machine model, this paper proposed a dynamic theme crawler system. The experimental result shows that, the dynamic theme crawler based on keywords and support vector machine can effectively acquire target information. This method can be flexibly applied in the fields of information security, the management of enterprise public relations crisis and so on.