Title of article
USAGE OF DEDICATED DATA STRUCTURES FOR URL DATABASES IN A LARGE-SCALE CRAWLING
Author/Authors
Krzysztof Dorosz، نويسنده ,
Issue Information
روزنامه با شماره پیاپی سال 2009
Pages
11
From page
7
To page
17
Abstract
The article discuss usage of Berkeley DB data structures such as hash tables and b-trees for implementation of a high performance URL database. The article presents a formal model for a data structures oriented URL database, which can be used as an alternative for a relational oriented URL database.
Keywords
Berkeley DB , Large-scale , URL repository , Crawling , URL database , DataStructures , crawler
Journal title
Computer Science
Serial Year
2009
Journal title
Computer Science
Record number
678233
Link To Document