Realtime synthesis of moving human-like agent in response to user´s moving image

Describes a parallel computing system and a software algorithm for realtime interaction between a human user and a synthesized moving humanlike image or agent. The realistic human-like agent appearing on a display can recognize the palm position and finger motion (finger sign) of the human user, then tracks and gazes at the hand position and changes his/her facial expression in response to the recognized finger sign in realtime. This kind of interactive agent is expected to play an important role in advanced human interfaces. To realize realtime image recognition and image synthesis, a parallel image processing and synthesis system named `TN-VIT´ has been developed