Context-based vision system for place and object recognition

Authors:
Antonio Torralba;Kevin P. Murphy;William T. Freeman;Mark A. Rubin
Affiliations:
-;-;-;-
Venue:
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Year:
2003

Citing 0
Cited 132

Relational sequential inference with reliable observations

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Contextual recognition of head gestures

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Place recognition system from long-term observations

IEA/AIE'2005 Proceedings of the 18th international conference on Innovations in Applied Artificial Intelligence
Multi-sensory and Multi-modal Fusion for Sentient Computing

International Journal of Computer Vision
PERSONE: personalized experience recoding and searching on networked environment

Proceedings of the 3rd ACM workshop on Continuous archival and retrival of personal experences
Rapid Biologically-Inspired Scene Classification Using Features Shared with Visual Attention

IEEE Transactions on Pattern Analysis and Machine Intelligence
Sequential inference with reliable observations: learning to construct force-dynamic models

Artificial Intelligence
Hierarchical building recognition

Image and Vision Computing
Robust model-based scene interpretation by multilayered context information

Computer Vision and Image Understanding
Supervised semantic labeling of places using information extracted from sensor data

Robotics and Autonomous Systems
From images to rooms

Robotics and Autonomous Systems
Head gestures for perceptual interfaces: The role of context in improving recognition

Artificial Intelligence
Scene completion using millions of photographs

ACM SIGGRAPH 2007 papers
Detecting Loop Closure with Scene Sequences

International Journal of Computer Vision
Outdoor place recognition using compact local descriptors and multiple queries with user verification

Proceedings of the 15th international conference on Multimedia
Object recognition using a generalized robust invariant feature and Gestalt's law of proximity and similarity

Pattern Recognition
Real-time object recognition using relational dependency based on graphical model

Pattern Recognition
Appearance-based localization for mobile robots using digital zoom and visual compass

Robotics and Autonomous Systems
Learning to Recognize Objects with Little Supervision

International Journal of Computer Vision
Learning to learn: From smart machines to intelligent machines

Pattern Recognition Letters
Novel indoor mobile robot navigation using monocular vision

Engineering Applications of Artificial Intelligence
FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance

International Journal of Robotics Research
Scene completion using millions of photographs

Communications of the ACM
Context-based recognition during human interactions: automatic feature selection and encoding dictionary

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Context-based design of robotic systems

Robotics and Autonomous Systems
View independent face detection based on horizontal rectangular features and accuracy improvement using combination kernel of various sizes

Pattern Recognition
Object fingerprints for content analysis with applications to street landmark localization

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Learning Spatial Context: Using Stuff to Find Things

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
An Image Completion Algorithm Using Occlusion-Free Images from Internet Photo Sharing Sites

IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
Short communication: Simultaneous place and object recognition using collaborative context information

Image and Vision Computing
Efficient exploration of unknown indoor environments using a team of mobile robots

Annals of Mathematics and Artificial Intelligence
A Context Model and Reasoning System to improve object trackingin complex scenarios

Expert Systems with Applications: An International Journal
Object-based Place Recognition for Mobile Robots Using Panoramas

Proceedings of the 2008 conference on Artificial Intelligence Research and Development: Proceedings of the 11th International Conference of the Catalan Association for Artificial Intelligence
Unsupervised modeling of objects and their hierarchical contextual interactions

Journal on Image and Video Processing - Special issue on patches in vision
Global Context Extraction for Object Recognition Using a Combination of Range and Visual Features

Dyn3D '09 Proceedings of the DAGM 2009 Workshop on Dynamic 3D Imaging
A variational learning algorithm for the abstract hidden Markov model

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 1
Semantic place classification of indoor environments with mobile robots using boosting

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 3
Sequential inference with reliable observations: Learning to construct force-dynamic models

Artificial Intelligence
Subspace learning-based dimensionality reduction in building recognition

Neurocomputing
Biologically inspired mobile robot vision localization

IEEE Transactions on Robotics
A computational model for the alignment of hierarchical scene representations in human-robot interaction

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
A realistic benchmark for visual indoor place recognition

Robotics and Autonomous Systems
Utilizing object-object and object-scene context when planning to find things

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
Co-occurrence graphs: contextual representation for head gesture recognition during multi-party interactions

Proceedings of the Workshop on Use of Context in Vision Processing
Hierarchical appearance-based classifiers for qualitative spatial localization

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Visual place categorization: problem, dataset, and algorithm

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Multi-modal Semantic Place Classification

International Journal of Robotics Research
Combining visual features and text data for medical image retrieval using latent semantic kernels

Proceedings of the international conference on Multimedia information retrieval
Image inpainting based on scene transform and color transfer

Pattern Recognition Letters
Automatic word detection system for document image using mobile devices

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques
Personalized life log media system in ubiquitous environment

ICUCT'06 Proceedings of the 1st international conference on Ubiquitous convergence technology
A framework of context-aware object recognition for smart home

ICOST'07 Proceedings of the 5th international conference on Smart homes and health telematics
The more you learn, the less you store: Memory-controlled incremental SVM for visual place recognition

Image and Vision Computing
Place recognition using multiple wearable cameras

UCS'07 Proceedings of the 4th international conference on Ubiquitous computing systems
Deriving a priori co-occurrence probability estimates for object recognition from social networks and text processing

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part II
Recognizing activities with multiple cues

Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
Conditional sequence model for context-based recognition of gaze aversion

MLMI'07 Proceedings of the 4th international conference on Machine learning for multimodal interaction
Selecting local region descriptors with a genetic algorithm for real-world place recognition

Evo'08 Proceedings of the 2008 conference on Applications of evolutionary computing
Scene classification based on multi-resolution orientation histogram of Gabor features

ICVS'08 Proceedings of the 6th international conference on Computer vision systems
Context based object categorization: A critical survey

Computer Vision and Image Understanding
Context ranking machine and its application to rigid localization of deformable objects

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Track-based self-supervised classification of dynamic obstacles

Autonomous Robots
Automatically acquiring a semantic network of related concepts

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
A swarm cognition realization of attention, action selection, and spatial memory

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Scene categorization using boosted back-propagation neural networks

PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Predicting affordances from gist

SAB'10 Proceedings of the 11th international conference on Simulation of adaptive behavior: from animals to animats
Multi-cue discriminative place recognition

CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Joint people, event, and location recognition in personal photo collections using cross-domain context

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Graph cut based inference with co-occurrence statistics

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
GRAVA --Context Programming

Proceedings of the 2010 conference on Biologically Inspired Cognitive Architectures 2010: Proceedings of the First Annual Meeting of the BICA Society
Searching the web with mobile images for location recognition

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Recovering human body configurations: combining segmentation and recognition

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Multiscale conditional random fields for image labeling

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Online and Incremental Appearance-based SLAM in Highly Dynamic Environments

International Journal of Robotics Research
Balancing deformability and discriminability for shape matching

ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
An improved fusion method based on adaboost algorithm for semantic concept extraction

ICIMCS '10 Proceedings of the Second International Conference on Internet Multimedia Computing and Service
Research and applications on georeferenced multimedia: a survey

Multimedia Tools and Applications
Context modeling in computer vision: techniques, implications, and applications

Multimedia Tools and Applications
Boosted scene categorization approach by adjusting inner structures and outer weights of weak classifiers

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part I
Generative group activity analysis with quaternion descriptor

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
Exploiting Textons distributions on spatial hierarchy for scene classification

Journal on Image and Video Processing - Special issue on selected papers from multimedia modeling conference 2009
Indoor scene classification using combined 3D and gist features

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
PLBP: An effective local binary patterns texture descriptor with pyramid representation

Pattern Recognition
Malware images: visualization and automatic classification

Proceedings of the 8th International Symposium on Visualization for Cyber Security
A software for performance evaluation and comparison of people detection and tracking methods in video processing

Multimedia Tools and Applications
Unsupervised scene classification based on context of features for a mobile robot

KES'11 Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part I
An extended-HCT semantic description for visual place recognition

International Journal of Robotics Research
A comparative assessment of malware classification using binary texture analysis and dynamic analysis

Proceedings of the 4th ACM workshop on Security and artificial intelligence
Scene parsing using a prior world model

International Journal of Robotics Research
Photo stream alignment for collaborative photo collection and sharing in social media

WSM '11 Proceedings of the 3rd ACM SIGMM international workshop on Social media
Context-Based scene recognition using bayesian networks with scale-invariant feature transform

ACIVS'06 Proceedings of the 8th international conference on Advanced Concepts For Intelligent Vision Systems
Interactive learning of scene context extractor using combination of bayesian network and logic network

ACIVS'06 Proceedings of the 8th international conference on Advanced Concepts For Intelligent Vision Systems
Scene interpretation: unified modeling of visual context by particle-based belief propagation in hierarchical graphical model

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
Multi-instance multi-label learning based on Gaussian process with application to visual mobile robot navigation

Information Sciences: an International Journal
A Bayesian approach for place recognition

Robotics and Autonomous Systems
Activity-Object bayesian networks for detecting occluded objects in uncertain indoor environment

KES'05 Proceedings of the 9th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part III
Corpus-guided sentence generation of natural images

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
CAPIRE: a context-aware points of interest REcognition system using a CBIR approach

FMN'10 Proceedings of the Third international conference on Future Multimedia Networking
Histogram of Oriented Uniform Patterns for robust place recognition and categorization

International Journal of Robotics Research
Image texts-based navigation for augmented game

Edutainment'06 Proceedings of the First international conference on Technologies for E-Learning and Digital Entertainment
Large-scale Gaussian process classification using random decision forests

Pattern Recognition and Image Analysis
PLISS: labeling places using online changepoint detection

Autonomous Robots
Nearest-Neighbor based Metric Functions for indoor scene recognition

Computer Vision and Image Understanding
Orientation-aware scene understanding for mobile cameras

Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Image statistics for clustering paintings according to their visual appearance

Computational Aesthetics'09 Proceedings of the Fifth Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging
Object Detection using Geometrical Context Feedback

International Journal of Computer Vision
Boosting k-NN for Categorization of Natural Scenes

International Journal of Computer Vision
Hierarchical Classifiers for Robust Topological Robot Localization

Journal of Intelligent and Robotic Systems
Describing video contents in natural language

HYBRID '12 Proceedings of the Workshop on Innovative Hybrid Approaches to the Processing of Textual Data
Biologically inspired task oriented gist model for scene classification

Computer Vision and Image Understanding
Spring lattice counting grids: scene recognition using deformable positional constraints

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Local label descriptor for example based semantic image labeling

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VII
ISABoost: A weak classifier inner structure adjusting based AdaBoost algorithm-ISABoost based application in scene categorization

Neurocomputing
Scene classification based on category-specific representations created through prototype feature selection

Proceedings of the 27th Conference on Image and Vision Computing New Zealand
Networks of transform-based evolvable features for object recognition

Proceedings of the 15th annual conference on Genetic and evolutionary computation
Neural-swarm visual saliency for path following

Applied Soft Computing
Human reidentification with transferred metric learning

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Object templates for visual place categorization

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part IV
Multiple feature fusion based on co-training approach and time regularization for place classification in wearable video

Advances in Multimedia
Image search—from thousands to billions in 20 years

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special Sections on the 20th Anniversary of ACM International Conference on Multimedia, Best Papers of ACM Multimedia 2012
Bubble space and place representation in topological maps

International Journal of Robotics Research
Inference Methods for CRFs with Co-occurrence Statistics

International Journal of Computer Vision
Malware analysis method using visualization of binary files

Proceedings of the 2013 Research in Adaptive and Convergent Systems
Object class detection: A survey

ACM Computing Surveys (CSUR)
SigMal: a static signal processing based malware triage

Proceedings of the 29th Annual Computer Security Applications Conference
High-level attributes modeling for indoor scenes classification

Neurocomputing
A spatio-temporal Long-term Memory approach for visual place recognition in mobile robotic navigation

Robotics and Autonomous Systems
Learning spatially semantic representations for cognitive robot navigation

Robotics and Autonomous Systems
Local features and histogram based planar object recognition

Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication
What makes an image popular?

Proceedings of the 23rd international conference on World wide web
New color GPHOG descriptors for object and scene image classification

Machine Vision and Applications
HWVP: hierarchical wavelet packet descriptors and their applications in scene categorization and semantic concept retrieval

Multimedia Tools and Applications

Quantified Score

Hi-index	0.02

Visualization

Abstract

While navigating in an environment, a vision system has to be ableto recognize where it is and what the main objects in the sceneare. In this paper we present a context-based vision system forplace and object recognition. The goal is to identify familiarlocations (e.g., office 610, conference room 941, Main Street), tocategorize new environments (office, corridor, street) and to usethat information to provide contextual priors for objectrecognition (e.g., tables are more likely in an office than astreet). We present a low-dimensional global image representationthat provides relevant information for place recognition andcategorization, and show how such contextual information introducesstrong priors that simplify object recognition. We have trained thesystem to recognize over 60 locations (indoors and outdoors) and tosuggest the presence and locations of more than 20 different objecttypes. The algorithm has been integrated into a mobile system thatprovides real-time feedback to the user.