Detecting hands, fingers and blobs for multi-touch display applications

Author

de F.O.Araujo, T. ; Lima, Antonio M N ; Santos, Alexsandro J V dos

Author_Institution

Embedded & Pervasive Comput. Lab., Univ. Fed. de Campina Grande, Campina Grande, Brazil

fYear

2009

fDate

21-24 June 2009

Firstpage

237

Lastpage

243

Abstract

Current multi-touch display applications are mostly based on blob interaction. Fingers are treated as blobs, acting like some ldquomulti-pointrdquo interaction agents. No association between hand, fingers and blob IDs is usually provided. In this article we have described a solution for this problem that allows new applications ranging from games to innovative ways for interacting with multi-touch interactive displays. It was also discussed an approach to handle hand, blob and finger recognition, as well as its association. Besides that, a modification of the TUIO protocol was proposed to convey the information regarding hand, fingers and blob association.

Keywords

haptic interfaces; human computer interaction; image recognition; interactive devices; learning (artificial intelligence); object detection; touch sensitive screens; TUIO protocol; blob detection; blob recognition; computer game; finger detection; finger recognition; hand detection; hand recognition; human computer interaction; multipoint blob interaction agent; multitouch interactive display application; training method; Cameras; Colored noise; Computer displays; Computer vision; Fingers; Hardware; Infrared detectors; Infrared heating; Operating systems; Optical receivers; Blob Tracking; Finger Recognition; Hand Recognition; Multi-touch Interactive Displays;

fLanguage

English

Publisher

ieee

Conference_Titel

High Performance Computing & Simulation, 2009. HPCS '09. International Conference on

Conference_Location

Leipzig

Print_ISBN

978-1-4244-4906-4

Electronic_ISBN

978-1-4244-4907-1

Type

conf

DOI

10.1109/HPCSIM.2009.5192305

Filename

5192305