Desktop scene analysis for document management system

In this report, we propose a method to support human intellectual activity by managing the history of document information on a desktop environment. Recently, many research groups have been focused on “desk” as an interactive environment in which projective display and user´s action can share the same physical space. Although our experimental setup is similar to these researches, our aim differs from their approach in the point that we limit the target to documents placed on a desktop to monitor the thinking process of a user from appearance. The system recognizes documents, folders, and stacks and their layout from a TV camera located above desk, and it also recognizes the motion of user´s hands to estimate the action. We indicate that the system can consistently manage personal documents even if they are cluttered on the desk