• DocumentCode
    1565089
  • Title

    Image-based talking heads using radial basis functions

  • Author

    Edge, James D. ; Maddock, Steve

  • Author_Institution
    Sheffield Univ., UK
  • fYear
    2003
  • Firstpage
    74
  • Lastpage
    80
  • Abstract
    In recent years talking heads have received a great deal of interest, both in their application to natural human-computer dialogue, and their benefit to the intelligibility of synthesized speech. A model for the realistic synthesis of visual speech animation is described. Images representing the key visual speech poses (visemes) are pre-recorded and labeled. Transitions between visemes are created by using an image morphing technique based upon the use of radial basis functions. Timing information from the festival speech synthesis system is used to plan the appropriate transitions to create realistic speech animation. A model of coarticulation is included in the system to improve the realism of articulatory motion.
  • Keywords
    computer animation; image morphing; radial basis function networks; speech intelligibility; speech synthesis; speech-based user interfaces; Festival speech synthesis system; articulatory motion; audio-visual speech synthesizer; coarticulation model; image morphing; image-based talking head; key visual speech poses; natural human-computer dialogue; radial basis function; realistic speech animation; realistic synthesis; synthesized speech intelligibility; timing information; visemes; visual speech animation; Deformable models; Facial animation; Focusing; Head; Interpolation; Lattices; Muscles; Scattering; Speech synthesis; Synthesizers;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Theory and Practice of Computer Graphics, 2003. Proceedings
  • Print_ISBN
    0-7695-1942-3
  • Type

    conf

  • DOI
    10.1109/TPCG.2003.1206933
  • Filename
    1206933