DocumentCode
3600003
Title
A Parallel Algorithm to Mine Abnormal Patterns from Satellite Data
Author
Yuhang Xu ; Dechang Pi
Author_Institution
Coll. of Comput. Sci. & Technol., Nanjing Univ. of Aeronaut. & Astronaut., Nanjing, China
fYear
2014
Firstpage
53
Lastpage
59
Abstract
Mining abnormal patterns is important in many areas. With the prevalence of big data, in order to ensure efficiency, an algorithm named PPSpan (JOMP-based parallel Prefix Span) is proposed under the research of traditional serial sequential pattern mining methods. Firstly, redundant parameters are eliminated with grey correlation analysis. Secondly, outlier information is extracted according to the corresponding parameter threshold and each parameter is discretized with information entropy. Finally, PPSpan algorithm is employed to mine patterns. The algorithm can effectively mined the abnormal patterns from big dataset. Moreover, we verify the feasibility and effectiveness of the proposed method through an experimental analysis of a certain satellite data.
Keywords
Big Data; Java; correlation methods; data mining; entropy; feature extraction; grey systems; parallel algorithms; Big Data; JOMP-based parallel PrefixSpan; Java implementation of OpenMP; Open Multiple Processing; PPSpan algorithm; abnormal pattern mining; grey correlation analysis; information entropy; outlier information extraction; parallel algorithm; parameter threshold; redundant parameters elimination; satellite data; serial sequential pattern mining methods; Algorithm design and analysis; Big data; Correlation; Data mining; Databases; Entropy; Information entropy; PPSpan; abnormal patterns; big data; grey correlation analysis; information entropy;
fLanguage
English
Publisher
ieee
Conference_Titel
Advanced Cloud and Big Data (CBD), 2014 Second International Conference on
Print_ISBN
978-1-4799-8086-4
Type
conf
DOI
10.1109/CBD.2014.16
Filename
7176072
Link To Document