DocumentCode
1685011
Title
Robust versions of the Tukey boxplot with their application to detection of outliers
Author
Shevlyakov, Georgy ; Andrea, Kliton ; Choudur, Lakshminarayan ; Smirnov, Pavel ; Ulanov, Alexander ; Vassilieva, Natalia
Author_Institution
Dept. of Appl. Math., St. Petersburg State Polytech. Univ., St. Petersburg, Russia
fYear
2013
Firstpage
6506
Lastpage
6510
Abstract
The need for fast on-line algorithms to analyze high data-rate measurements is a vital element in production settings. Given the ever-increasing number of data sources coupled with increasing complexity of applications, and workload patterns, anomaly detection methods should be light-weight and must operate in real-time. In many modern applications, data arrive in a streaming fashion. Therefore, the underlying assumption of classical methods that the data is a sample from a stable distribution is not valid, and Gaussian and non-parametric based methods such as the control chart and boxplot are inadequate. Streaming data is an ever-changing superposition of distributions. Detection of such changes in real-time is one of the fundamental challenges. We propose low-complexity robust modifications to the conventional Tukey boxplot based on fast highly efficient robust estimates of scale. Results using synthetic as well as real-world data show that our methods outperform the Tukey boxplot and methods based on Gaussian limits.
Keywords
data visualisation; statistical analysis; Tukey boxplot; anomaly detection method; low complexity robust modification; outlier detection; robust estimation; streaming data; Contamination; Data analysis; Electric breakdown; Pollution measurement; Probability; Robustness; Standards; boxplot; outlier; robustness;
fLanguage
English
Publisher
ieee
Conference_Titel
Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on
Conference_Location
Vancouver, BC
ISSN
1520-6149
Type
conf
DOI
10.1109/ICASSP.2013.6638919
Filename
6638919
Link To Document