• DocumentCode
    3600003
  • Title

    A Parallel Algorithm to Mine Abnormal Patterns from Satellite Data

  • Author

    Yuhang Xu ; Dechang Pi

  • Author_Institution
    Coll. of Comput. Sci. & Technol., Nanjing Univ. of Aeronaut. & Astronaut., Nanjing, China
  • fYear
    2014
  • Firstpage
    53
  • Lastpage
    59
  • Abstract
    Mining abnormal patterns is important in many areas. With the prevalence of big data, in order to ensure efficiency, an algorithm named PPSpan (JOMP-based parallel Prefix Span) is proposed under the research of traditional serial sequential pattern mining methods. Firstly, redundant parameters are eliminated with grey correlation analysis. Secondly, outlier information is extracted according to the corresponding parameter threshold and each parameter is discretized with information entropy. Finally, PPSpan algorithm is employed to mine patterns. The algorithm can effectively mined the abnormal patterns from big dataset. Moreover, we verify the feasibility and effectiveness of the proposed method through an experimental analysis of a certain satellite data.
  • Keywords
    Big Data; Java; correlation methods; data mining; entropy; feature extraction; grey systems; parallel algorithms; Big Data; JOMP-based parallel PrefixSpan; Java implementation of OpenMP; Open Multiple Processing; PPSpan algorithm; abnormal pattern mining; grey correlation analysis; information entropy; outlier information extraction; parallel algorithm; parameter threshold; redundant parameters elimination; satellite data; serial sequential pattern mining methods; Algorithm design and analysis; Big data; Correlation; Data mining; Databases; Entropy; Information entropy; PPSpan; abnormal patterns; big data; grey correlation analysis; information entropy;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Advanced Cloud and Big Data (CBD), 2014 Second International Conference on
  • Print_ISBN
    978-1-4799-8086-4
  • Type

    conf

  • DOI
    10.1109/CBD.2014.16
  • Filename
    7176072