Title :
Fast algorithm for computing weighted projection quantiles and data depth for high-dimensional large data clouds
Author :
Mukherjee, Ujjal Kumar ; Chatterjee, Saptarshi
Author_Institution :
Carlson Sch. of Manage., Univ. of Minnesota, Minneapolis, MN, USA
Abstract :
In this paper we present a new algorithm based on a weighted projection quantiles for fast and frugal real time quantile estimation of large sized high dimensional data clouds. We present a projection quantile regression algorithm for high dimensional data. Second, we present a fast algorithm for computing the depth of a point or a new observation in relation to any high-dimensional data cloud, and propose a ranking system for multivariate data. Third, we briefly describe a real time rapid monitoring scheme similar to statistical process monitoring, for actionable analytics with big data. We believe these algorithms would be very useful for real time analysis of high dimensional `big data´ sets including streaming data sets. The proposed algorithms would be of immense use in several application areas such as real time financial market analysis, real time remote health monitoring of patients using body area networked devices and real time pricing and inventory decisions in retail and manufacturing sector.
Keywords :
Big Data; cloud computing; data analysis; regression analysis; big data analytics; data depth; high-dimensional large data clouds; multivariate data; projection quantile regression algorithm; weighted projection quantiles; Accelerometers; Big data; Estimation; Monitoring; Real-time systems; Shape; Vectors; ‘Big Data’; body area network; data depth estimation; quantile regression; real time analysis; real time health monitoring; weighted projection quantiles;
Conference_Titel :
Big Data (Big Data), 2014 IEEE International Conference on
Conference_Location :
Washington, DC
DOI :
10.1109/BigData.2014.7004358