Image-Based Virtual Fitting System with Garment Image Reshaping

We propose an image-based virtual fitting system to reproduce the appearance of fitting during online shopping for garments. Inputs are whole-body images of a fashion model and the customer. We create a garment image by cutting out the garment portion from the image of the fashion model. If the garment images were naïvely superimposed, the fitting result would look strange mainly because the shape of the garment will not match the body shape of the customer. In this paper, we therefore propose a method of reshaping the garment image based on human body shapes of the fashion model and the customer to make the fitting result more realistic. The body shape is automatically estimated from the contours of the human body, and can easily be retouched if necessary. The fitting result is refined further by automatic color correction with reference to the facial regions and a method of retouching parts that protrude from the rear of the garment image. We verified the effectiveness of our system through a user test.