Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Early versus late fusion in semantic video analysis
Proceedings of the 13th annual ACM international conference on Multimedia
Early versus late fusion in semantic video analysis
Proceedings of the 13th annual ACM international conference on Multimedia
k-means++: the advantages of careful seeding
SODA '07 Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms
ACM Transactions on Knowledge Discovery from Data (TKDD)
Earthquake shakes Twitter users: real-time event detection by social sensors
Proceedings of the 19th international conference on World wide web
Conjugate mixture models for clustering multimodal data
Neural Computation
LIBSVM: A library for support vector machines
ACM Transactions on Intelligent Systems and Technology (TIST)
Finding media illustrating events
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Using social media to identify events
WSM '11 Proceedings of the 3rd ACM SIGMM international workshop on Social media
Heterogeneous image feature integration via multi-modal spectral clustering
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Social event detection with robust high-order co-clustering
Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Jointly exploiting visual and non-visual information for event-related social media retrieval
Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Automated social event detection in large photo collections
Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Social life networks: a multimedia problem?
Proceedings of the 21st ACM international conference on Multimedia
ReSEED: social event dEtection dataset
Proceedings of the 5th ACM Multimedia Systems Conference
Event identification in web social media through named entity recognition and topic modeling
Data & Knowledge Engineering
Hi-index | 0.00 |
A large variety of features can be extracted from raw multimedia items. Moreover, in many contexts, like in the case of multimedia uploaded by users of social media platforms, items may be linked to metadata that can be very useful for a variety of analysis tasks. Nevertheless, such features are typically heterogeneous and are difficult to combine in a unified representation that would be suitable for analysis. In this paper, we discuss the problem of clustering collections of multimedia items with the purpose of detecting social events. In order to achieve this, a novel multimodal clustering algorithm is proposed. The proposed method uses a known clustering in the currently examined domain, in order to supervise the multimodal fusion and clustering procedure. It is tested on the MediaEval social event detection challenge data and is compared to a multimodal spectral clustering approach that uses early fusion. By taking advantage of the explicit supervisory signal, it achieves superior clustering accuracy and additionally requires the specification of a much smaller number of parameters. Moreover, the proposed approach has wider scope; it is not only applicable to the task of social event detection, but to other multimodal clustering problems as well.