DocumentCode
106353
Title
Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features
Author
Hsin-Ho Yeh ; Chun-Yu Yang ; Ming-Sui Lee ; Chu-Song Chen
Author_Institution
Inst. of Inf. Sci., Taipei, Taiwan
Volume
15
Issue
8
fYear
2013
fDate
Dec. 2013
Firstpage
1944
Lastpage
1957
Abstract
This paper presents a new method for accessing the aesthetic quality of videos. It consists of two processes: aesthetic features construction and temporal integration. First, our method combines both photo-based and motion-based visual clues to extract the aesthetic features for each frame in a video. We introduce new motion-based features built from optical flow and salient region extraction, and show their effectiveness to enhance the estimation of aesthetic values. Then, a temporal-order-aware framework that integrates the frame-based features is presented to further improve the evaluation accuracy by taking the time-varying properties into consideration. The experimental results demonstrate that our approach can accomplish remarkable improvement for aesthetic quality assessment of videos.
Keywords
feature extraction; image motion analysis; image sequences; video signal processing; aesthetic feature extraction; aesthetic features construction; frame-based feature; motion-based features; optical flow; photo-based features; salient region extraction; temporal integration; temporal-order-aware framework; time-varying property; video aesthetic quality assessment; visual clues; Accuracy; Feature extraction; Image color analysis; Lighting; Quality assessment; Video recording; Visualization; Aesthetic quality assessment; computational aesthetics; image quality assessment; video quality assessment; visual aesthetics;
fLanguage
English
Journal_Title
Multimedia, IEEE Transactions on
Publisher
ieee
ISSN
1520-9210
Type
jour
DOI
10.1109/TMM.2013.2280250
Filename
6588329
Link To Document