An Agent-Based Multimodal Interface for Sketch Interpretation

We present a multimodal interface for sketch interpretation that relies on a multi-agent architecture. The design of the interpretation engine and the different agents are based on a user-centered approach where efficiency measure is defined as user satisfaction. So far, several graphical agents have been implemented for recognizing basic graphical objects (e.g. lines, circles, etc.) as well as more complex (e.g., hatches, stairs, captions, etc) in architectural design. Besides, vocal agents have been developed for recognizing spoken annotations (e.g. dimensions) and interface commands. Realistic evaluations with professional users have demonstrated the potential interest of the proposed system