• DocumentCode
    727496
  • Title

    Visual summary of egocentric photostreams by representative keyframes

  • Author

    Bolanos, Marc ; Mestre, Ricard ; Talavera, Estefania ; Giro-i-Nieto, Xavier ; Radeva, Petia

  • Author_Institution
    Univ. de Barcelona, Barcelona, Spain
  • fYear
    2015
  • fDate
    June 29 2015-July 3 2015
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    Building a visual summary from an egocentric photostream captured by a lifelogging wearable camera is of high interest for different applications (e.g. memory reinforcement). In this paper, we propose a new summarization method based on keyframes selection that uses visual features extracted by means of a convolutional neural network. Our method applies an unsupervised clustering for dividing the photostreams into events, and finally extracts the most relevant keyframe for each event. We assess the results by applying a blind-taste test on a group of 20 people who assessed the quality of the summaries.
  • Keywords
    cameras; convolution; feature extraction; neural nets; pattern clustering; personal computing; unsupervised learning; blind-taste test; convolutional neural network; egocentric photostreams; keyframe selection; lifelogging wearable camera; memory reinforcement; representative keyframes; summarization method; unsupervised clustering; visual feature extraction; visual summary; Cameras; Feature extraction; Image segmentation; Indexes; Motion segmentation; Videos; Visualization; egocentric; keyframes; lifelogging; summarization;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Multimedia & Expo Workshops (ICMEW), 2015 IEEE International Conference on
  • Conference_Location
    Turin
  • Type

    conf

  • DOI
    10.1109/ICMEW.2015.7169863
  • Filename
    7169863