Instant scene recognition on mobile platform

Authors:
Sebastiano Battiato;Giovanni Maria Farinella;Mirko Guarnera;Daniele Ravì;Valeria Tomaselli
Affiliations:
Image Processing Laboratory, University of Catania, Italy;Image Processing Laboratory, University of Catania, Italy;Advanced System Technology, STMicroelectronics, Catania, Italy;Image Processing Laboratory, University of Catania, Italy;Advanced System Technology, STMicroelectronics, Catania, Italy
Venue:
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Year:
2012

Citing 6
Cited 2

Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope

International Journal of Computer Vision
The Frankencamera: an experimental platform for computational photography

ACM SIGGRAPH 2010 papers
LIBSVM: A library for support vector machines

ACM Transactions on Intelligent Systems and Technology (TIST)
Exploiting Textons distributions on spatial hierarchy for scene classification

Journal on Image and Video Processing - Special issue on selected papers from multimedia modeling conference 2009
A mathematical analysis of the DCT coefficient distributions for images

IEEE Transactions on Image Processing
Improving Color Constancy Using Indoor–Outdoor Image Classification

IEEE Transactions on Image Processing

Human-inspired features for natural scene classification

Pattern Recognition Letters
Computationally Efficient Formulation of Sparse Color Image Recovery in the JPEG Compressed Domain

Journal of Mathematical Imaging and Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

Scene recognition is extremely useful to improve different tasks involved in the Image Generation Pipeline of single sensor mobile devices (e.g., white balancing, autoexposure, etc). This demo showcases our scene recognition engine implemented on a Nokia N900 smartphone. The engine exploits an image representation directly obtainable in the IGP of mobile devices. The demo works in realtime and it is able to discriminate among different classes of scenes. The framework is built by employing the FCam API to have an easy and precise control of the mobile digital camera. Each acquired image (or frame of a video) is holistically represented starting from the statistics collected on DCT domain. This allow instant and "free of charge" feature extraction process since the DCT is always computed into the IGP of a mobile for storage purposes (i.e., JPEG or MPEG format). A SVM classifier is used to perform the final inference about the context of the scene.