Real-time analytics processing with MapReduce

Author

Peng, Cheng-zhang ; Jiang, Ze-jun ; Cai, Xiao-bin ; Zhang, Zhi-ke

Author_Institution

Sch. of Comput. Sci. & Technol., Northwestern Polytech. Univ., Xi´´an, China

Volume

4

fYear

2012

fDate

15-17 July 2012

Firstpage

1308

Lastpage

1311

Abstract

Many real-time analytical applications over massive data streams were performed by usually introducing a specific stream processing core. In general, these SPCs were not popularly applied to enterprises same as MapReduce, even if now real-time analytics applications are taken into attention more and more. For reversing this tide, we developed a new analytics system. Our system modified the stock Hadoop´s MapReduce programming model and execution framework, and used Chord model as temporary data, Cassandra as its persistent storage. With our system, we can develop data stream processing application with the familiar MapReduce programming model.

Keywords

Internet; data handling; real-time systems; Chord model; MapReduce programming; SPC; massive data streams; persistent storage; real-time analytics processing; stream processing core; Abstracts; Adaptation models; Computational modeling; Monitoring; Programming; Real-time systems; Storms; Cassandra; Data stream processing; JOL; MapReduce; Real-time analytics;

fLanguage

English

Publisher

ieee

Conference_Titel

Machine Learning and Cybernetics (ICMLC), 2012 International Conference on

Conference_Location

Xian

ISSN

2160-133X

Print_ISBN

978-1-4673-1484-8

Type

conf

DOI

10.1109/ICMLC.2012.6359554

Filename

6359554