• DocumentCode
    1278272
  • Title

    The Haptic Deictic System—HDS: Bringing Blind Students to Mainstream Classrooms

  • Author

    Oliveira, Francisco CMB ; Quek, Francis ; Cowan, Heidi ; Fang, Bing

  • Author_Institution
    Ceara State Univ., Fortaleza, Brazil
  • Volume
    5
  • Issue
    2
  • fYear
    2012
  • Firstpage
    172
  • Lastpage
    183
  • Abstract
    Mathematics instruction and discourse typically involve two modes of communication: speech and graphical presentation. For the communication to remain situated, dynamic synchrony must be maintained between the speech and dynamic focus in the graphics. In sighted people, vision is used for two purposes: access to graphical material and awareness of embodied behavior. This embodiment awareness keeps communication situated with visual material and speech. Our goal is to assist students who are blind or visually impaired (SBVI) in the access to such instruction/communication. We employ the typical approach of sensory replacement for the missing visual sense. Haptic fingertip reading can replace visual material. We want to make the SBVI aware of the deictic gestures performed by the teacher over the graphic in conjunction with speech. We employ a haptic glove interface to facilitate this embodiment awareness. We address issues from the conception through the design and implementation to the effective and successful use of our Haptic Deictic System (HDS) in inclusive classrooms.
  • Keywords
    computer graphics; data gloves; gesture recognition; handicapped aids; mathematics; vision defects; HDS; blind students; deictic gestures; embodied behavior awareness; graphical material; graphical presentation; haptic deictic system; haptic fingertip reading; haptic glove interface; mainstream classrooms; mathematics discourse; mathematics instruction; sensory replacement; speech communication; visual material; visual sense; visually impaired students; Actuators; Haptic interfaces; Mathematics; Speech; Vibrations; Visualization; Haptic glove; assistive technology.; discourse; embodied skill; gaming; multimodal interaction;
  • fLanguage
    English
  • Journal_Title
    Haptics, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1939-1412
  • Type

    jour

  • DOI
    10.1109/TOH.2011.35
  • Filename
    5959164