• DocumentCode
    3410811
  • Title

    On the Development of an Interactive Talking Head System

  • Author

    Athanasopoulos, Michael ; Ugail, Hassan ; Castro, Gabriela González

  • Author_Institution
    Sch. of Comput., Inf. & Media, Univ. of Bradford, Bradford, UK
  • fYear
    2010
  • fDate
    20-22 Oct. 2010
  • Firstpage
    414
  • Lastpage
    420
  • Abstract
    In this work we propose a talking head system for animating facial expressions using a template face generated from partial differential equations (PDE). It uses a set of pre configured curves to calculate an internal template surface face. This surface is then used to associate various facial features with a given 3D face object. Motion retargeting is then used to transfer the deformations in these areas from the template to the target object. The procedure is continued until all the expressions in the database are calculated and transferred to the target 3D human face object. Additionally the system interacts with the user using an artificial intelligence (AI) chatter bot to generate response from a given text. Speech and facial animation are synchronized using the Microsoft Speech API, where the response from the AI bot is converted to speech.
  • Keywords
    application program interfaces; artificial intelligence; computer animation; curve fitting; face recognition; image motion analysis; interactive systems; partial differential equations; speech processing; 3D face object; 3D human face object; AI chatter bot; Microsoft speech API; PDE; artificial intelligence; facial animation; facial expressions animation; facial features; interactive talking head system; internal template surface face; motion retargeting; partial differential equations; pre configured curves; speech animation; template face; Engines; Face; Facial animation; Humans; Speech; Three dimensional displays; Facial animation; Motion retargeting; PDE method and Virtual interactive enviroments; Speech animation;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Cyberworlds (CW), 2010 International Conference on
  • Conference_Location
    Singapore
  • Print_ISBN
    978-1-4244-8301-3
  • Electronic_ISBN
    978-0-7695-4215-7
  • Type

    conf

  • DOI
    10.1109/CW.2010.53
  • Filename
    5656268