Swiping with luminophonics

Author

Tan, Shern Shiou ; Maul, Tomas Henrique Bode ; Mennie, Neil Russel ; Mitchell, Peter

Author_Institution

Sch. of Comput. Sci., Univ. of Nottingham Malaysia Campus, Semenyih, Malaysia

fYear

2010

fDate

28-30 June 2010

Firstpage

52

Lastpage

57

Abstract

Luminophonics is a system that aims to maximize cross-modality conversion of information, specifically from the visual to auditory modalities, with the motivation to develop a better assistive technology for the visually impaired by using image sonification techniques. The project aims to research and develop generic and highly-configurable components concerned with different image processing techniques, attention mechanisms, orchestration approaches and psychological constraints. The swiping method that is introduced in this paper combines several techniques in order to explicitly convert the colour, size and position of objects. Preliminary tests suggest that the approach is valid and deserves further investigation.

Keywords

handicapped aids; image colour analysis; object detection; assistive technology; attention mechanisms; auditory modalities; image processing techniques; image sonification techniques; luminophonics; object colour; object position; object size; orchestration approach; psychological constraints; visual modalities; Acoustic noise; Auditory displays; Computer science; Computer vision; Image converters; Image processing; Image segmentation; Psychology; Testing; Usability; Auditory Display; Computer Vision; Image Processing; Image Sonification;

fLanguage

English

Publisher

ieee

Conference_Titel

Cybernetics and Intelligent Systems (CIS), 2010 IEEE Conference on

Conference_Location

Singapore

Print_ISBN

978-1-4244-6499-9

Type

conf

DOI

10.1109/ICCIS.2010.5518580

Filename

5518580