Title :
Fast Snippet Generation Based on CPU-GPU Hybrid System
Author :
Liu, Ding ; Li, Ruixuan ; Gu, Xiwu ; Wen, Kunmei ; He, Heng ; Gao, Guoqiang
Author_Institution :
Intell. & Distrib. Comput. Lab., Huazhong Univ. of Sci. & Technol., Wuhan, China
Abstract :
As an important part of searching result presentation, query-biased document snippet generation has become a popular method of search engines that makes the result list more informative to users. Generating a single snippet is a lightweight task. However, it will be a heavy workload to generate multiple snippets of multiple documents as the search engines need to process large amount of queries per second, and each result list usually contains several snippets. To deal with this heavy workload, we propose a new high-performance snippet generation approach based on CPU-GPU hybrid system. Our main contribution of this paper is to present a parallel processing stream for large-scale snippet generation tasks using GPU. We adopt a sliding document segmentation method in our approach which costs more computing resources but can avoid the common defect that the high relevant fragment may be cut off. The experimental results show that our approach gains a speedup of nearly 6 times in average process time compared with the baseline approach-Highlighter.
Keywords :
document handling; graphics processing units; parallel processing; search engines; CPU-GPU hybrid system; fast snippet generation; high-performance snippet generation approach; large-scale snippet generation; parallel processing stream; query-biased document snippet generation; search engines; sliding document segmentation; Graphics processing unit; Parallel processing; Search engines; Sorting; Throughput; Time factors; Vectors; CPU-GPU hybrid system; graphics processing unit; parallel processing stream; query-biased snippet generation; sliding document segmentation;
Conference_Titel :
Parallel and Distributed Systems (ICPADS), 2011 IEEE 17th International Conference on
Conference_Location :
Tainan
Print_ISBN :
978-1-4577-1875-5
DOI :
10.1109/ICPADS.2011.63