In the eye of the beholder: employing statistical analysis and eye tracking for analyzing abstract paintings

  • Authors:
  • Victoria Yanulevskaya;Jasper Uijlings;Elia Bruni;Andreza Sartori;Elisa Zamboni;Francesca Bacci;David Melcher;Nicu Sebe

  • Affiliations:
  • University of Trento, Trento, Italy;University of Trento, Trento, Italy;University of Trento, Trento, Italy;Telecom Italia - SKIL, Trento, Italy;University of Trento, Trento, Italy;Museum of Art of Trento and Rovereto, Rovereto, Italy;University of Trento, Trento, Italy;University of Trento, Trento, Italy

  • Venue:
  • Proceedings of the 20th ACM international conference on Multimedia
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most artworks are explicitly created to evoke a strong emotional response. During the centuries there were several art movements which employed different techniques to achieve emotional expressions conveyed by artworks. Yet people were always consistently able to read the emotional messages even from the most abstract paintings. Can a machine learn what makes an artwork emotional? In this work, we consider a set of 500 abstract paintings from Museum of Modern and Contemporary Art of Trento and Rovereto (MART), where each painting was scored as carrying a positive or negative response on a Likert scale of 1-7. We employ a state-of-the-art recognition system to learn which statistical patterns are associated with positive and negative emotions. Additionally, we dissect the classification machinery to determine which parts of an image evokes what emotions. This opens new opportunities to research why a specific painting is perceived as emotional. We also demonstrate how quantification of evidence for positive and negative emotions can be used to predict the way in which people observe paintings.