Title :
Characterizing a Heterogeneous System for Person Detection in Video Using Histograms of Oriented Gradients: Power Versus Speed Versus Accuracy
Author :
Blair, Charlotte ; Robertson, Neil M. ; Hume, D.
Author_Institution :
Visionlab, Heriot-Watt Univ., Edinburgh, UK
Abstract :
This paper presents a new implementation, with complete analysis, of the processing operations required in a widely-used pedestrian detection algorithm (the histogram of oriented gradients (HOG) detector) when run in various configurations on a heterogeneous platform suitable for use as an embedded system. The platform consists of field-programmable gate array (FPGA), graphics processing unit (GPU), and central processing unit (CPU) and we detail the advantages of such an image processing system for real-time performance. We thoroughly analyze the consequent tradeoffs made between power consumption, latency and accuracy for each possible configuration. We thus demonstrate that prioritization of each of these factors can be made by selecting a specific configuration. These separate configurations may then be changed dynamically to respond to changing priorities of a real-time system, e.g., on a moving vehicle. We compare the performance of real-time implementations of linear and kernel support vector machines in HOG and evaluate the entire system against the state-of-the-art in real-time person detection. We also show that our FPGA implementation detects pedestrians more accurately than existing implementations, and that a heterogeneous configuration which performs image scaling on the GPU, and histogram extraction and classification on the FPGA, produces a good compromise between power and speed.
Keywords :
embedded systems; field programmable gate arrays; graphics processing units; power consumption; support vector machines; video signal processing; CPU; FPGA; GPU; HOG; central processing unit; embedded system; field-programmable gate array; graphics processing unit; heterogeneous system; histogram extraction; image processing system; image scaling; oriented gradients detector; pedestrian detection algorithm; power consumption; real-time person detection; real-time system; support vector machines; Field-programmable gate array (FPGA); graphics processing unit (GPU); histogram of oriented gradients (HOG); pedestrian detection;
Journal_Title :
Emerging and Selected Topics in Circuits and Systems, IEEE Journal on
DOI :
10.1109/JETCAS.2013.2256821