AutoCaption: Automatic caption generation for personal photos

Author

Ramnath, Krishnan ; Baker, Simon ; Vanderwende, Lucy ; El-Saban, Motaz ; Sinha, Sudipta N. ; Kannan, Ajaykumar ; Hassan, Norfaeza ; Galley, Michel ; Yi Yang ; Ramanan, D. ; Bergamo, Alessandro ; Torresani, Lorenzo

Author_Institution

Microsoft Res., Microsoft Corp., Redmond, WA, USA

fYear

2014

fDate

24-26 March 2014

Firstpage

1050

Lastpage

1057

Abstract

AutoCaption is a system that helps a smartphone user generate a caption for their photos. It operates by uploading the photo to a cloud service where a number of parallel modules are applied to recognize a variety of entities and relations. The outputs of the modules are combined to generate a large set of candidate captions, which are returned to the phone. The phone client includes a convenient user interface that allows users to select their favorite caption, reorder, add, or delete words to obtain the grammatical style they prefer. The user can also select from multiple candidates returned by the recognition modules.

Keywords

client-server systems; cloud computing; image recognition; mobile computing; smart phones; user interfaces; AutoCaption; automatic caption generation; cloud service; grammatical style; parallel modules; personal photos; phone client; recognition modules; smartphone; user interface; Clouds; Databases; Face; Face recognition; Generators; Global Positioning System; User interfaces;

fLanguage

English

Publisher

ieee

Conference_Titel

Applications of Computer Vision (WACV), 2014 IEEE Winter Conference on

Conference_Location

Steamboat Springs, CO

Type

conf

DOI

10.1109/WACV.2014.6835988

Filename

6835988