Title :
A Parallel Algorithm to Mine Abnormal Patterns from Satellite Data
Author :
Yuhang Xu ; Dechang Pi
Author_Institution :
Coll. of Comput. Sci. & Technol., Nanjing Univ. of Aeronaut. & Astronaut., Nanjing, China
Abstract :
Mining abnormal patterns is important in many areas. With the prevalence of big data, in order to ensure efficiency, an algorithm named PPSpan (JOMP-based parallel Prefix Span) is proposed under the research of traditional serial sequential pattern mining methods. Firstly, redundant parameters are eliminated with grey correlation analysis. Secondly, outlier information is extracted according to the corresponding parameter threshold and each parameter is discretized with information entropy. Finally, PPSpan algorithm is employed to mine patterns. The algorithm can effectively mined the abnormal patterns from big dataset. Moreover, we verify the feasibility and effectiveness of the proposed method through an experimental analysis of a certain satellite data.
Keywords :
Big Data; Java; correlation methods; data mining; entropy; feature extraction; grey systems; parallel algorithms; Big Data; JOMP-based parallel PrefixSpan; Java implementation of OpenMP; Open Multiple Processing; PPSpan algorithm; abnormal pattern mining; grey correlation analysis; information entropy; outlier information extraction; parallel algorithm; parameter threshold; redundant parameters elimination; satellite data; serial sequential pattern mining methods; Algorithm design and analysis; Big data; Correlation; Data mining; Databases; Entropy; Information entropy; PPSpan; abnormal patterns; big data; grey correlation analysis; information entropy;
Conference_Titel :
Advanced Cloud and Big Data (CBD), 2014 Second International Conference on
Print_ISBN :
978-1-4799-8086-4
DOI :
10.1109/CBD.2014.16