Connecting content to community in social media via image content, user tags and user communication

  • Authors:
  • Munmun De Choudhury;Hari Sundaram;Yu-Ru Lin;Ajita John;Doree Duncan Seligmann

  • Affiliations:
  • Arts, Media & Engineering, Arizona State University, Tempe, AZ;Arts, Media & Engineering, Arizona State University, Tempe, AZ;Arts, Media & Engineering, Arizona State University, Tempe, AZ;Collaborative Applications Research, Avaya Labs, Lincroft, NJ;Collaborative Applications Research, Avaya Labs, Lincroft, NJ

  • Venue:
  • ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we develop a recommendation framework to connect image content with communities in online social media. The problem is important because users are looking for useful feedback on their uploaded content, but finding the right community for feedback is challenging for the end user. Social media are characterized by both content and community. Hence, in our approach, we characterize images through three types of features: visual features, user generated text tags, and social interaction (user communication history in the form of comments). A recommendation framework based on learning a latent space representation of the groups is developed to recommend the most likely groups for a given image. The model was tested on a large corpus of Flickr images comprising 15, 689 images. Our method outperforms the baseline method, with a mean precision 0.62 and mean recall 0.69. Importantly, we show that fusing image content, text tags with social interaction features outperforms the case of only using image content or tags.