Optimizing search engines using clickthrough data
Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
The Design of High-Level Features for Photo Quality Assessment
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
IEEE Transactions on Pattern Analysis and Machine Intelligence
Photo and Video Quality Evaluation: Focusing on the Subject
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part III
Evaluating Color Descriptors for Object and Scene Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Towards computational models of the visual aesthetic appeal of consumer videos
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
A holistic approach to aesthetic enhancement of photographs
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special section on ACM multimedia 2010 best paper candidates, and issue on social media
Single Image Haze Removal Using Dark Channel Prior
IEEE Transactions on Pattern Analysis and Machine Intelligence
Studying aesthetics in photographic images using a computational approach
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part III
Aesthetic quality classification of photographs based on color harmony
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Action recognition by dense trajectories
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images
IEEE Transactions on Image Processing
Robust late fusion with rank minimization
CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
AVA: A large-scale database for aesthetic visual analysis
CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Assessing the aesthetic quality of photographs using generic image descriptors
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Content-based photo quality assessment
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Large-scale visual sentiment ontology and detectors using adjective noun pairs
Proceedings of the 21st ACM international conference on Multimedia
| Hi-index | 0.00 |
In this paper we propose a novel aesthetic model emphasizing psycho-visual statistics extracted from multiple levels in contrast to earlier approaches that rely only on descriptors suited for image recognition or based on photographic principles. At the lowest level, we determine dark-channel, sharpness and eye-sensitivity statistics over rectangular cells within a frame. At the next level, we extract Sentibank features (1,200 pre-trained visual classifiers) on a given frame, that invoke specific sentiments such as "colorful clouds", "smiling face" etc. and collect the classifier responses as frame-level statistics. At the topmost level, we extract trajectories from video shots. Using viewer's fixation priors, the trajectories are labeled as foreground, and background/camera on which statistics are computed. Additionally, spatio-temporal local binary patterns are computed that capture texture variations in a given shot. Classifiers are trained on individual feature representations independently. On thorough evaluation of 9 different types of features, we select the best features from each level -- dark channel, affect and camera motion statistics. Next, corresponding classifier scores are integrated in a sophisticated low-rank fusion framework to improve the final prediction scores. Our approach demonstrates strong correlation with human prediction on 1,000 broadcast quality videos released by NHK as an aesthetic evaluation dataset.