Title :
A scalable P2P platform for the knowledge grid
Author :
Zhuge, Hai ; Sun, Xiaoping ; Liu, Jie ; Yao, Erlin ; Chen, Xue
Author_Institution :
China Knowledge Grid Res. Group, Chinese Acad. of Sci., Beijing, China
Abstract :
The knowledge grid needs to operate with a scalable platform to provide large-scale intelligent services. A key function of such a platform is to efficiently support various complex queries in a dynamic large-scale network environment. This paper proposes a platform to support index-based path queries by incorporating a semantic overlay with an underlying structured P2P network that provides object location and management services. Various distributed indexing structures can be dynamically formed by publishing, semantic objects as indexing nodes. Queries are forwarded along the chains of semantic object pointers to search for objects. We investigate the deployment of a scalable distributed trie index for broadcast queries on key strings, propose a decentralized load balancing method for solving the problem of uneven load distribution incurred by heterogeneity of loads and node capacities and by the distributed trie index, and give an approach for improving the availability of the semantic overlay and its trie index. Experiments demonstrate the scalability of the proposed platform.
Keywords :
data mining; database indexing; grid computing; peer-to-peer computing; query processing; resource allocation; decentralized load balancing method; distributed indexing structures; distributed trie index; index-based path queries; knowledge grid; large-scale intelligent services; semantic object pointers; semantic overlay; structured P2P network; uneven load distribution; Availability; Broadcasting; Environmental management; Indexing; Knowledge management; Large-scale systems; Load management; Publishing; Scalability; Sun; Index Terms- Peer-to-peer; distributed trie index; knowledge grid; load balancing; path query; replication.; semantic overlay;
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
DOI :
10.1109/TKDE.2005.190