On second order operators and quadratic operators

In pattern recognition, computer vision, and image processing, many approaches are based on second order operators. Well-known examples are second order networks, the 3D structure tensor for motion estimation, and the Harris corner detector. A subset of second order operators are quadratic operators. It is lesser known that every second order operator can be written as a weighted quadratic operator. The contribution of this paper is to propose an algorithm for converting an arbitrary second order operator into a quadratic operator. We apply the method to several examples from image processing and machine learning. The advantages of the alternative implementation by quadratic operators is two-fold: The underlying linear operators allow new insights into the theory of the respective second order operators and replacing second order networks with sums of squares of linear networks reduces significantly the computational burden when the trained network is in operation phase.