Recognition of Screen-Rendered Text

The recognition of screen-rendered text is to our knowledge a yet unaddressed task. It has to be performed e.g. by translation tools which allow users to click on any text on the screen and give a translation. This often requires to capture a screenshot and to perform optical character recognition which is very challenging due to very small and smoothed fonts. This paper presents a method capable of recognizing smoothed and non-smoothed screen-rendered text of very small size which also works for colored fonts on inhomogeneous backgrounds