Enriching user profiling with affective features for the improvement of a multimodal recommender system

Authors:
Ioannis Arapakis;Yashar Moshfeghi;Hideo Joho;Reede Ren;David Hannah;Joemon M. Jose
Affiliations:
University of Glasgow, Lilybank Gardens, Glasgow;University of Glasgow, Lilybank Gardens, Glasgow;University of Glasgow, Lilybank Gardens, Glasgow;University of Glasgow, Lilybank Gardens, Glasgow;University of Glasgow, Lilybank Gardens, Glasgow;University of Glasgow, Lilybank Gardens, Glasgow
Venue:
Proceedings of the ACM International Conference on Image and Video Retrieval
Year:
2009

Citing 9
Cited 8

Relevance feedback revisited

SIGIR '92 Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval
Adaptive interfaces for ubiquitous web access

Communications of the ACM - The Adaptive Web
MovieLens unplugged: experiences with an occasionally connected recommender system

Proceedings of the 8th international conference on Intelligent user interfaces
Amazon.com Recommendations: Item-to-Item Collaborative Filtering

IEEE Internet Computing
Self-Adaptive User Profiles for Large-Scale Data Delivery

ICDE '00 Proceedings of the 16th International Conference on Data Engineering
Feature-based recommendation system

Proceedings of the 14th ACM international conference on Information and knowledge management
Multimodal human-computer interaction: A survey

Computer Vision and Image Understanding
Facial Expression Recognition: A Fully Integrated Approach

ICIAPW '07 Proceedings of the 14th International Conference of Image Analysis and Processing - Workshops
Affective feedback: an investigation into the role of emotions in the information seeking process

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval

Affective adaptive retrieval: study of emotion in adaptive retrieval

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Using facial expressions and peripheral physiological signals as implicit indicators of topical relevance

MM '09 Proceedings of the 17th ACM international conference on Multimedia
A comparison of general vs personalised affective models for the prediction of topical relevance

Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Implicit image tagging via facial information

Proceedings of the 2nd international workshop on Social signal processing
Theories, methods and current research on emotions in library and information science, information retrieval and human-computer interaction

Information Processing and Management: an International Journal
Understanding relevance: an fMRI study

ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
An effective implicit relevance feedback technique using affective, physiological and behavioural features

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
On cognition, emotion, and interaction aspects of search tasks with different search intentions

Proceedings of the 22nd international conference on World Wide Web

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recommender systems have been systematically applied in industry and academia to help users cope with information uncertainty. However, given the multiplicity of the preferences and needs it has been shown that no approach is suitable for all users in all situations. Thus, it is believed that an effective recommender system should incorporate a variety of techniques and features to offer valuable recommendations and enhance the search experience. In this paper we propose a novel video search interface that employs a multimodal recommender system, which can predict topical relevance. The multimodal recommender accounts for interaction data, contextual information, as well as users' affective responses, and exploits these information channels to provide meaningful recommendations of unseen videos. Our experiment shows that the multimodal interaction feature is a promising way to improve the performance of recommendation.