• DocumentCode
    3255595
  • Title

    Distributed data cleansing via a low-rank decomposition

  • Author

    Schizas, Ioannis D.

  • Author_Institution
    Dept. of EE, Univ. of Texas at Arlington, Arlington, TX, USA
  • fYear
    2013
  • fDate
    3-5 Dec. 2013
  • Firstpage
    827
  • Lastpage
    830
  • Abstract
    Data acquired across sensors may contain irrelevant components such as interference and noise. A distributed framework is put forth that enables sensors to extract the `clean´ portion of a data sequence and isolate the corrupted data. Different from outliers, the corrupted data may affect an arbitrary in size portion of the data sequence. The clean informative data usually consist of low-dimensional components giving rise to a low-rank data covariance matrix, while the presence of irrelevant data increases the rank. This property leads to a novel constrained minimization formulation that combines low-rank matrix decomposition and data selection. A separable formulation is further derived which is tackled via coordinate descent techniques and the alternating direction method of multipliers. Numerical tests demonstrate the potential of the novel distributed scheme.
  • Keywords
    covariance matrices; data acquisition; distributed processing; minimisation; sensor fusion; alternating direction method; constrained minimization formulation; coordinate descent techniques; corrupted data isolation; data selection; data sequence clean portion extraction; distributed data cleansing; distributed framework; low-dimensional components; low-rank data covariance matrix; low-rank decomposition; low-rank matrix decomposition; Covariance matrices; Distributed databases; Interference; Minimization; Noise; Sensors; Vectors; Data cleansing; distributed processing; low-rank decomposition;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Global Conference on Signal and Information Processing (GlobalSIP), 2013 IEEE
  • Conference_Location
    Austin, TX
  • Type

    conf

  • DOI
    10.1109/GlobalSIP.2013.6737019
  • Filename
    6737019