Recognition of Ingredients and Recipes of Cookery Shows for Value Added Service (VAS) of an Interactive Set Top Box (iSTB)

In this paper, authors have proposed a VAS for personal video recorder (PVR) enabled iSTB. The proposed solution can recognize the regions in the frames where the recipe and ingredients are shown and can save them in image/text format for further use. We have used a hybrid approach where the text regions are localized using the compress domain features of the streaming video in real time and then some pixel domain processing is performed on that reduced region of interest to recognize the text. The novelty of the proposed approach lies in using the compressed domain features of H.264 video in text localization and applying some pixel domain post processing on the ROI to perform the entire recognition process in real time. The system is tested over a video upto CIF resolution and can recognize the text successfully with an accuracy of nearly 80%.