IR evaluation methods for retrieving highly relevant documents
SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Methods and metrics for cold-start recommendations
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Relational Distance-Based Clustering
ILP '98 Proceedings of the 8th International Workshop on Inductive Logic Programming
Fast Radial Symmetry for Detecting Points of Interest
IEEE Transactions on Pattern Analysis and Machine Intelligence
The Journal of Machine Learning Research
Information-theoretic co-clustering
Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Hierarchical clustering of WWW image search results using visual, textual and link information
Proceedings of the 12th annual ACM international conference on Multimedia
Automatic Analysis of Multimodal Group Actions in Meetings
IEEE Transactions on Pattern Analysis and Machine Intelligence
Graph based multi-modality learning
Proceedings of the 13th annual ACM international conference on Multimedia
Multi-way distributional clustering via pairwise interactions
ICML '05 Proceedings of the 22nd international conference on Machine learning
Using phase information for symmetry detection
Pattern Recognition Letters
ICML '06 Proceedings of the 23rd international conference on Machine learning
Latent semantic analysis for multiple-type interrelated data objects
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Group formation in large social networks: membership, growth, and evolution
Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Unsupervised learning on k-partite graphs
Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Topics over time: a non-Markov continuous-time model of topical trends
Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Structure and evolution of online social networks
Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Phase congruence measurement for image similarity assessment
Pattern Recognition Letters
World explorer: visualizing aggregate data from unstructured text in geo-referenced collections
Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
Combining content and link for classification using matrix factorization
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
GraphScope: parameter-free mining of large time-evolving graphs
Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
Watch what I watch: using community activity to understand content
Proceedings of the international workshop on Workshop on multimedia information retrieval
Contextual wisdom: social relations and correlations for multimedia event annotation
Proceedings of the 15th international conference on Multimedia
Proceedings of the 15th international conference on Multimedia
Diva: a variance-based clustering approach for multi-type relational data
Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Proceedings of the 17th international conference on World Wide Web
Flickr tag recommendation based on collective knowledge
Proceedings of the 17th international conference on World Wide Web
Facetnet: a framework for analyzing communities and their evolutions in dynamic networks
Proceedings of the 17th international conference on World Wide Web
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Community evolution in dynamic multi-mode networks
Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
Personalized, interactive tag recommendation for flickr
Proceedings of the 2008 ACM conference on Recommender systems
SheepDog: group and tag recommendation for flickr photos by automatic search-based learning
MM '08 Proceedings of the 16th ACM international conference on Multimedia
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
The co-creation machine: managing co-creative processes for the crowd
EGOVIS'12/EDEM'12 Proceedings of the 2012 Joint international conference on Electronic Government and the Information Systems Perspective and Electronic Democracy, and Proceedings of the 2012 Joint international conference on Advancing Democracy, Government and Governance
Detecting profilable and overlapping communities with user-generated multimedia contents in LBSNs
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Hi-index | 0.00 |
In this article, we present a novel algorithm to discover multirelational structures from social media streams. A media item such as a photograph exists as part of a meaningful interrelationship among several attributes, including time, visual content, users, and actions. Discovery of such relational structures enables us to understand the semantics of human activity and has applications in content organization, recommendation algorithms, and exploratory social network analysis. We are proposing a novel nonnegative matrix factorization framework to characterize relational structures of group photo streams. The factorization incorporates image content features and contextual information. The idea is to consider a cluster as having similar relational patterns; each cluster consists of photos relating to similar content or context. Relations represent different aspects of the photo stream data, including visual content, associated tags, photo owners, and post times. The extracted structures minimize the mutual information of the predicted joint distribution. We also introduce a relational modularity function to determine the structure cost penalty, and hence determine the number of clusters. Extensive experiments on a large Flickr dataset suggest that our approach is able to extract meaningful relational patterns from group photo streams. We evaluate the utility of the discovered structures through a tag prediction task and through a user study. Our results show that our method based on relational structures, outperforms baseline methods, including feature and tag frequency based techniques, by 35%--420%. We have conducted a qualitative user study to evaluate the benefits of our framework in exploring group photo streams. The study indicates that users found the extracted clustering results clearly represent major themes in a group; the clustering results not only reflect how users describe the group data but often lead the users to discover the evolution of the group activity.