MIWD: Multidimensional indexing for web documents

Search engines use indexes for fast accessing data in order to answer user queries. Data can be web documents, pictures, spatial data, etc. Usually, inverted indexing is used to index web documents. In this paper, we introduce a new indexing method for web documents using multidimensional indexing approach named MIWD. First, we describe inverted indexing, two compression methods and a traditional indexing method for spatial data objects. Then, a new indexing method and its distributed version based on spatial data indexing for web documents are introduced. It distributes document indexes in many machines to make our method fast and scalable. At the end, we compare our results for insertion and retrieving web documents with traditional indexing methods.