Title :
A real-time applicable 3D gesture recognition system for automobile HMI
Author :
Kopinski, Thomas ; Geisler, Stefan ; Caron, Louis-Charles ; Gepperth, Alexander ; Handmann, Uwe
Author_Institution :
Hochschule Ruhr West - Univ. of Appl. Sci., Bottrop, Germany
Abstract :
We present a system for 3D hand gesture recognition based on low-cost time-of-flight(ToF) sensors intended for outdoor use in automotive human-machine interaction. As signal quality is impaired compared to Kinect-type sensors, we study several ways to improve performance when a large number of gesture classes is involved. Our system fuses data coming from two ToF sensors which is used to build up a large database and subsequently train a multilayer perceptron (MLP). We demonstrate that we are able to reliably classify a set of ten hand gestures in real-time and describe the setup of the system, the utilised methods as well as possible application scenarios.
Keywords :
automobiles; gesture recognition; image classification; image fusion; image sensors; intelligent transportation systems; man-machine systems; multilayer perceptrons; 3D hand gesture recognition system; MLP; ToF sensors; automobile HMI; automotive human-machine interaction; data fusion; hand gesture classification; multilayer perceptron; time-of-flight sensors; Artificial neural networks; Cameras; Databases; Neurons; Sensors; Three-dimensional displays; Training;
Conference_Titel :
Intelligent Transportation Systems (ITSC), 2014 IEEE 17th International Conference on
Conference_Location :
Qingdao
DOI :
10.1109/ITSC.2014.6958109