Behaviors and Communications in Working Support through First Person Vision Communication

This paper introduces a novel idea of analyzing logs of "working support through first person vision (FPV) communication", a working style in which a worker with a head-mounted camera works under the guidance of an experienced mentor monitoring the FPV at a distance. The logs contain various types of multimodal interactions concerning intentions, instructions, and explanations as well as usual working information. We first propose frequent pattern extraction and investigation of the resultant characteristics, and subsequently show experimentally that some characteristics are tightly linked to the smoothness of the work environment and failures.