The study and implementation of micro-blog search engine based on nutch

Author

Zhang, Kai ; Du, Yuncheng ; Lv, Xueqiang ; Shi, Shuicai

Author_Institution

Chinese Inf. Process. Res. Center, Beijing Inf. Sci. & Technol. Univ., Beijing, China

Volume

1

fYear

2010

fDate

21-24 May 2010

Abstract

Through introducing and analyzing the new form of media called micro-blog, we have concluded the characteristics of micro-blog and website structure features. Then we gave concrete realization of the search engine based on nutch technology, and transformed the existing Chinese word segmentation system. Finally the search engine was built completely. After the analysis of the collected data, we found micro-blog site features. What is more, we found that five-depth was the best depth for micro-blog.

Keywords

Web sites; data analysis; natural languages; search engines; text analysis; word processing; Chinese word segmentation system; Website structure features; collected data analysis; microblog search engine; nutch technology; Information processing; Information science; Information services; Information technology; Internet; Scattering; Search engines; Twitter; Uniform resource locators; Web sites; Micro-blog; Twitter; search engine; web gathering;

fLanguage

English

Publisher

ieee

Conference_Titel

Future Computer and Communication (ICFCC), 2010 2nd International Conference on

Conference_Location

Wuhan

Print_ISBN

978-1-4244-5821-9

Type

conf

DOI

10.1109/ICFCC.2010.5497309

Filename

5497309