Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
International Journal of Computer Vision
Large-Scale Concept Ontology for Multimedia
IEEE MultiMedia
To search or to label?: predicting the performance of search-based automatic image classifiers
MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
Recognizing contextual polarity in phrase-level sentiment analysis
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Opinion Mining and Sentiment Analysis
Foundations and Trends in Information Retrieval
Foundations and Trends in Information Retrieval
Video2Text: Learning to Annotate Video Content
ICDMW '09 Proceedings of the 2009 IEEE International Conference on Data Mining Workshops
The Pascal Visual Object Classes (VOC) Challenge
International Journal of Computer Vision
Learning automatic concept detectors from online video
Computer Vision and Image Understanding
Affective image classification using features inspired by psychology and art theory
Proceedings of the international conference on Multimedia
Efficient object category recognition using classemes
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Sentiment in short strength detection informal text
Journal of the American Society for Information Science and Technology
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Lookapp: interactive construction of web-based concept detectors
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
A holistic approach to aesthetic enhancement of photographs
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special section on ACM multimedia 2010 best paper candidates, and issue on social media
Studying aesthetics in photographic images using a computational approach
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part III
What makes an image memorable?
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Assessing the aesthetic quality of photographs using generic image descriptors
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Proceedings of the 20th ACM international conference on Multimedia
Can we understand van gogh's mood?: learning to infer affects from images in social networks
Proceedings of the 20th ACM international conference on Multimedia
Intent and its discontents: the user at the wheel of the online video search engine
Proceedings of the 20th ACM international conference on Multimedia
Scaring or pleasing: exploit emotional impact of an image
Proceedings of the 20th ACM international conference on Multimedia
Understanding the emotional impact of images
Proceedings of the 20th ACM international conference on Multimedia
Emotion-based sequence of family photos
Proceedings of the 20th ACM international conference on Multimedia
Proceedings of the 21st ACM international conference on Multimedia
Towards a comprehensive computational model foraesthetic assessment of videos
Proceedings of the 21st ACM international conference on Multimedia
Proceedings of the 23rd international conference on World wide web
Hi-index | 0.00 |
We address the challenge of sentiment analysis from visual content. In contrast to existing methods which infer sentiment or emotion directly from visual low-level features, we propose a novel approach based on understanding of the visual concepts that are strongly related to sentiments. Our key contribution is two-fold: first, we present a method built upon psychological theories and web mining to automatically construct a large-scale Visual Sentiment Ontology (VSO) consisting of more than 3,000 Adjective Noun Pairs (ANP). Second, we propose SentiBank, a novel visual concept detector library that can be used to detect the presence of 1,200 ANPs in an image. The VSO and SentiBank are distinct from existing work and will open a gate towards various applications enabled by automatic sentiment analysis. Experiments on detecting sentiment of image tweets demonstrate significant improvement in detection accuracy when comparing the proposed SentiBank based predictors with the text-based approaches. The effort also leads to a large publicly available resource consisting of a visual sentiment ontology, a large detector library, and the training/testing benchmark for visual sentiment analysis.