Using context with statistical relational models: object recognition from observing user activity in home environment

Authors:
Chen Wu;Hamid Aghajan
Affiliations:
Stanford University, Stanford, CA;Stanford University, Stanford, CA
Venue:
Proceedings of the Workshop on Use of Context in Vision Processing
Year:
2009

Citing 9
Cited 5

Contextual Priming for Object Detection

International Journal of Computer Vision
Combining Image Regions and Human Activity for Indirect Object Recognition in Indoor Wide-Angle Views

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Markov logic networks

Machine Learning
Efficient adaptive density estimation per image pixel for the task of background subtraction

Pattern Recognition Letters
A survey of advances in vision-based human motion capture and analysis

Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Conditional models for contextual human motion recognition

Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Object categorization

Foundations and Trends® in Computer Graphics and Vision
User centered research in experiencelab

AmI'07 Proceedings of the 2007 European conference on Ambient intelligence
Markov logic

Probabilistic inductive logic programming

Use of context in vision processing: an introduction to the UCVP 2009 workshop

Proceedings of the Workshop on Use of Context in Vision Processing
Ontology-driven image analysis for histopathological images

ISVC'10 Proceedings of the 6th international conference on Advances in visual computing - Volume Part I
Contextual information and covariance descriptors for people surveillance: an application for safety of construction workers

Journal on Image and Video Processing - Special issue on advanced video-based surveillance
Local response context applied to pedestrian detection

CIARP'11 Proceedings of the 16th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
The learning of adjectives and nouns from affordance and appearance features

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Object recognition from images in a home environment is challenging since the object usually has low resolution in the image and the scene is usually cluttered. However, many objects have specific functions to the user and the interactions between the user and the object provides useful contextual information to recognize the object. In this paper, we use Markov logic network (MLN) to model such context information as relationship between the objects and user activities. We demonstrate that Markov logic network provides a flexible way in the syntax of first-order logic to incorporate relational context information. It is also a probabilistic graphical model which handles uncertainty in the knowledge base, observations and decisions. In our experiment, objects in the living room and kitchen in a home are recognized based on only user's activity. The user's activity is analyzed from images of cameras installed in the home. Relationship between user activity and objects is defined in a knowledge base with MLN. Experiments show that objects in the home can be recognized irrespective of their position, size and appearance in the image.