• DocumentCode
    3341251
  • Title

    System based on machine vision for translation of fingerspelling alphabet to latin alphabet

  • Author

    Lancheros-Cuesta, Diana ; Seidel Schlenker, Chiara ; Morales, Luis Fernando

  • Author_Institution
    Ing. en Automatizacion, Univ. de La Salle, Bogota, Colombia
  • fYear
    2015
  • fDate
    17-20 June 2015
  • Firstpage
    1
  • Lastpage
    5
  • Abstract
    On the nowadays society exist a lot of communication problems, particularly when the persons has sensory disabilities as deafness or blindness. This problem take place at the moment of interpreting the sign language. The present paper shows the development of a current research project that integrates an intelligent system in the recognition of images and its reproduction in hardware interpretations ends. For those purposes, a system of image acquisition with a webcam and an interface was implemented in Matlab, through which the video was displayed in real time, the image of the point gained, together with the translation of Colombian sign language. This system was trained to recognize 4-letter alphabet, obtaining an average error of 2%, concluding that such application was effective for translating letters acquired both the right hand or the left; similarly concluded that the type of radial neural network proves to be very useful for this type of operation and the higher classification have this training, the results will be more accurate cast. Finally it is important to note that the system integrates hardware with Arduino system that displays real-time translation in this system was trained to recognize 4 letters of the alphabet, giving an average error of 2%, the same way the PNN neural network proves to be very useful for this type of sorting operations.
  • Keywords
    computer vision; handicapped aids; image sensors; language translation; neural nets; sign language recognition; 4-letter alphabet; Arduino system; Colombian sign language translation; Latin alphabet; Matlab; PNN neural network; blindness; communication problems; deafness; fingerspelling alphabet translation; hardware interpretations; image acquisition; images recognition; machine vision; radial neural network; real-time translation; sensory disabilities; sorting operations; webcam; Assistive technology; Biological neural networks; Gesture recognition; Image recognition; MATLAB; Training; Artificial Vision; Image Treatment; Neuronal Networks; Smart Recognition;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Systems and Technologies (CISTI), 2015 10th Iberian Conference on
  • Conference_Location
    Aveiro
  • Type

    conf

  • DOI
    10.1109/CISTI.2015.7170450
  • Filename
    7170450