Projection and least square fitting with perpendicular offsets based vehicle license plate tilt correction

In the process of vehicle license plate (VLP) automatic recognition, tilt correction is a very essential and inevitable task. In this paper, according to the least square fitting with perpendicular offsets (LSFPO), the VLP region is fitted to a straight line. After the line slope is obtained, rotation angle of the VLP is estimated. Then the whole image is rotated for tilt correction in horizontal direction by this angle. Tilt correction in vertical direction by minimizing the variance of coordinates of the projection points is proposed. Character segmentation is performed after horizontal correction and character points are projected along the vertical direction after shear transform. Despite the success of VLP detection approaches in the past decades, a few of them can effectively locate license plate (LP), even when vehicle bodies and LPs have similar color. A common drawback of color-based VLP detection is the failure to detect the boundaries or border of LPs. In this paper, we propose a modified recursive labeling algorithm for solving this problem and detecting candidate regions. Various LP images were used with a variety of conditions to test the proposed method and results are presented to prove its effectiveness.