• DocumentCode
    1685011
  • Title

    Robust versions of the Tukey boxplot with their application to detection of outliers

  • Author

    Shevlyakov, Georgy ; Andrea, Kliton ; Choudur, Lakshminarayan ; Smirnov, Pavel ; Ulanov, Alexander ; Vassilieva, Natalia

  • Author_Institution
    Dept. of Appl. Math., St. Petersburg State Polytech. Univ., St. Petersburg, Russia
  • fYear
    2013
  • Firstpage
    6506
  • Lastpage
    6510
  • Abstract
    The need for fast on-line algorithms to analyze high data-rate measurements is a vital element in production settings. Given the ever-increasing number of data sources coupled with increasing complexity of applications, and workload patterns, anomaly detection methods should be light-weight and must operate in real-time. In many modern applications, data arrive in a streaming fashion. Therefore, the underlying assumption of classical methods that the data is a sample from a stable distribution is not valid, and Gaussian and non-parametric based methods such as the control chart and boxplot are inadequate. Streaming data is an ever-changing superposition of distributions. Detection of such changes in real-time is one of the fundamental challenges. We propose low-complexity robust modifications to the conventional Tukey boxplot based on fast highly efficient robust estimates of scale. Results using synthetic as well as real-world data show that our methods outperform the Tukey boxplot and methods based on Gaussian limits.
  • Keywords
    data visualisation; statistical analysis; Tukey boxplot; anomaly detection method; low complexity robust modification; outlier detection; robust estimation; streaming data; Contamination; Data analysis; Electric breakdown; Pollution measurement; Probability; Robustness; Standards; boxplot; outlier; robustness;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on
  • Conference_Location
    Vancouver, BC
  • ISSN
    1520-6149
  • Type

    conf

  • DOI
    10.1109/ICASSP.2013.6638919
  • Filename
    6638919