Collaborative Guidance System Using Multi-gaze History and Shared Photograph Collection

In this paper, we propose a collaborative guidance system which provides information extracted from a shared photo collection based on a user´s context. The user´s gaze history is used to determine the user´s situation in the real world. In our proposed system, we use a photograph viewpoint logging (PVL) system, which was previously developed to record the real world as photographs with viewpoint information (based on the photographer´s position and direction of gaze). In the prototype of the PVL system, a user terminal consisting of a mobile phone with an attached motion sensor, a GPS sensor, and a notebook PC is used for logging the position and orientation of the mobile phone. Based on the PVL system, we design the collaborative guidance system by using a multi-gaze history and the shared photograph collection. After a user takes two or three photographs consecutively, the collaborative guidance system provides useful and well-processed content based on the user situation.