Semantic based image retrieval: a probabilistic approach
MULTIMEDIA '00 Proceedings of the eighth ACM international conference on Multimedia
Content-Based Image Retrieval at the End of the Early Years
IEEE Transactions on Pattern Analysis and Machine Intelligence
Unifying Keywords and Visual Contents in Image Retrieval
IEEE MultiMedia
Reasoning about Binary Topological Relations
SSD '91 Proceedings of the Second International Symposium on Advances in Spatial Databases
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Evaluating the impact of selection noise in community-based web search
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Methods for automatic and assisted image annotation
Multimedia Tools and Applications
Hi-index | 0.00 |
This paper addresses the image semantic gap (i.e. the difficulty to automatically characterize the image semantic content through extracted low-level signal features) by investigating the formation of semantic concepts (such as mountains, sky, grass...) in a population of image agents:abstract structures representing the image visual entities. Through the development of processes mapping extracted low-level features to concept-based visual information, our contribution is twofold. First, we propose a learning framework mapping signal (color, texture) and semantic concepts to highlight the image agents. Contrary to traditional architectures considering high-dimensional spaces of low-level extracted signal features, this framework addresses the curse of dimensionality. Then, at the image agent population level, the agents communicate about the perceived semantic concepts with no access to global information or to the representations of other agents, they only exchange conceptual information. While doing so they adapt their internal representations to be more successful at conveying the perceived semantic information in future interactions. The image content is therefore soundly inferred through these concept-based linguistic interactions.The SIR Agent prototype implements our theoretical framework and its architecture revolves around functional modules enabling the characterization of concept-based linguistic structures, highlighting the image agents and enforcing interactions and coordination between them.