Development of pen based interface system for digital operation

We aim to realize a novel pen based interface system that provides various digital operations for both low-tech and high-tech people. In this paper, we propose a new digital pen device which can estimate handwriting trajectories only with embedded sensors, such as a strain gauge and a IMU (Inertia Measurement Unit). First we developed a strain gauge based digital pen device and a handwriting-trajectory-estimation algorithm specialized for it. Second we developed an IMU based digital pen device and an estimation algorithm specialize for the IMU based pen. These two pen devices and corresponding algorithms were evaluated in the estimation accuracy experimentally and we discussed an integration method of these two devices. Moreover, we developed an algorithm that associates drawn shapes, such as a circle and a rectangle, with operating commands, such as message input, address input. Using a commercially available digital pen, we confirmed that our proposed command detection and operation algorithm worked well and outperformed an usual e-mail sending operation in time.