DocumentCode :
239731
Title :
Parallelizing sparse recovery algorithms: A stochastic approach
Author :
Shah, Aamer ; Majumdar, Angshul
Author_Institution :
Indian Inst. of Technol., Guwahati, Guwahati, India
fYear :
2014
fDate :
20-23 Aug. 2014
Firstpage :
124
Lastpage :
129
Abstract :
This work proposes a novel technique for accelerating sparse recovery algorithms on multi-core shared memory architectures. All prior works attempt to speed-up algorithms by leveraging the speed-ups in matrix-vector products offered by the GPU. A major limitation of these studies is that in most signal processing applications, the operators are not available as explicit matrices but as implicit fast operators. In such a practical scenario, the prior techniques fail to speed up the sparse recovery algorithms. Our work is based on the principles of stochastic gradient descent. The main sequential bottleneck of sparse recovery methods is a gradient descent step. Instead of computing the full gradient, we compute multiple stochastic gradients in parallel cores; the full gradient is estimated by averaging these stochastic gradients. The other step of sparse recovery algorithms is a shrinkage operation which is inherently parallel. Our proposed method has been compared with existing sequential algorithms. We find that our method is as accurate as the sequential version but is significantly faster - the larger the size of the problem, the faster is our method.
Keywords :
gradient methods; matrix algebra; memory architecture; multiprocessing systems; parallel algorithms; shared memory systems; signal processing; stochastic processes; GPU; implicit fast operators; matrix-vector products; multicore shared memory architectures; multiple stochastic gradients; parallel cores; parallelizing sparse recovery algorithms; sequential algorithms; signal processing; stochastic gradient descent approach; Acceleration; Digital signal processing; Graphics processing units; Signal processing algorithms; Sparse matrices; Vectors; Compressive Sensing; Parallel Stochastic Gradient Descent; Sparse Signal Recovery;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Digital Signal Processing (DSP), 2014 19th International Conference on
Conference_Location :
Hong Kong
Type :
conf
DOI :
10.1109/ICDSP.2014.6900814
Filename :
6900814
Link To Document :
بازگشت