Review of Slug Semantic Web

This study introduces “Slug” a web crawler (or “Scutter”) that is designed for harvesting semantic web content. Slug provides a configurable, modular framework that allows an acceptable level of flexibility in configuring the retrieval, processing and storage of harvested content. In this framework RDF vocabulary helps to describe crawler configurations. Crawling activity, based on metadata, allows for reporting and analyzing the crawling progress, as well as more efficient retrieving through the storage caching data.