A system for intelligent context based content mode in camera applications

This paper proposes a content based mode in camera based applications and image viewers, where the system recognizes the type of content in the image and automatically links it to other applications. When the device is in content mode, all the images viewed or accessed have an extra context based menu based on the detected data (such as call number and email). The user can switch between the normal mode and this content mode, while using the device, by performing a simple gesture. This mode can also be plugged in to any number of services available on the device. Such a feature would make it much easier for users to perform useful actions directly from the image, saving several intermediate steps. We provide methods for the user to manipulate and share the content accessed through the camera, including browsing the links, saving a new contact, and so on. We review existing applications where parts of this feature have been implemented, especially in calling cards. Then we describe the system architecture and algorithm for implementing the content mode generally in all applications on the device, as well as APIs useful for third party application developers. We also provide sample user interfaces where this mode can used.