Synthesizing a high-resolution image of a lecture room using lecturer tracking camera and planar object capturing camera

We propose a method for synthesizing an undistorted high-resolution image of a lecture room. A certain degree of high-resolution videos can be captured using commercially available high-resolution cameras. However, the resolution of objects captured by these cameras is not enough for viewers of a lecture video. To get sufficient high-resolution lecture videos, we synthesize multiple images captured by low cost cameras using a planar perspective projection. However, lecturers are distorted by the projection because they are not planar objects and do not exist on planar objects in a lecture room. To get an undistorted figure of a lecturer, we introduce a fixed-viewpoint projection using a lecturer tracking camera. As a result, we could get more high-resolution images including an undistorted figure of a lecturer than ones captured by a standard high-resolution camera.