Automatically characterizing places with opportunistic crowdsensing using smartphones

Authors:
Yohan Chon;Nicholas D. Lane;Fan Li;Hojung Cha;Feng Zhao
Affiliations:
Yonsei University, Seoul, Korea;Microsoft Research Asia, Beijing, China;Microsoft Research Asia, Beijing, China;Yonsei University, Seoul, Korea;Microsoft Research Asia, Beijing, China
Venue:
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Year:
2012

Citing 28
Cited 15

Term-weighting approaches in automatic text retrieval

Information Processing and Management: an International Journal
Comparison of different implementations of MFCC

Journal of Computer Science and Technology
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope

International Journal of Computer Vision
Location-Aware Information Delivery with ComMotion

HUC '00 Proceedings of the 2nd international symposium on Handheld and Ubiquitous Computing
Wearable computing and contextual awareness

Wearable computing and contextual awareness
Latent dirichlet allocation

The Journal of Machine Learning Research
Using GPS to learn significant locations and predict movement across multiple users

Personal and Ubiquitous Computing
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)
Discovering personally meaningful places: An interactive clustering approach

ACM Transactions on Information Systems (TOIS)
Techniques for Improving Opportunistic Sensor Networking Performance

DCOSS '08 Proceedings of the 4th IEEE international conference on Distributed Computing in Sensor Systems
Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application

Proceedings of the 6th ACM conference on Embedded network sensor systems
Cooperative Techniques Supporting Sensor-Based People-Centric Inferencing

Pervasive '08 Proceedings of the 6th International Conference on Pervasive Computing
SurroundSense: mobile phone localization via ambience fingerprinting

Proceedings of the 15th annual international conference on Mobile computing and networking
Discovering semantically meaningful places from pervasive RF-beacons

Proceedings of the 11th international conference on Ubiquitous computing
Encountering SenseCam: personal recording technologies in everyday life

Proceedings of the 11th international conference on Ubiquitous computing
Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Visual place categorization: problem, dataset, and algorithm

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
SensLoc: sensing everyday places and paths using less energy

Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems
Jyotish: A novel framework for constructing predictive model of people movement from joint Wifi/Bluetooth trace

PERCOM '11 Proceedings of the 2011 IEEE International Conference on Pervasive Computing and Communications
On the semantic annotation of places in location-based social networks

Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining
Tapping into the Vibe of the city using VibN, a continuous sensing application for smartphones

Proceedings of 1st international symposium on From digital footprints to social and community intelligence
Employing user feedback for semantic location services

Proceedings of the 13th international conference on Ubiquitous computing
Snap and Translate Using Windows Phone

ICDAR '11 Proceedings of the 2011 International Conference on Document Analysis and Recognition
Mobility prediction-based smartphone energy optimization for everyday location monitoring

Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
Learning location naming from user check-in histories

Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems
Learning and recognizing the places we go

UbiComp'05 Proceedings of the 7th international conference on Ubiquitous Computing
Place-Its: a study of location-based reminders on mobile phones

UbiComp'05 Proceedings of the 7th international conference on Ubiquitous Computing
Ensemble of exemplar-SVMs for object detection and beyond

ICCV '11 Proceedings of the 2011 International Conference on Computer Vision

Autonomous place naming system using opportunistic crowdsensing and knowledge from crowdsourcing

Proceedings of the 12th international conference on Information processing in sensor networks
Auditeur: a mobile-cloud service platform for acoustic event detection on smartphones

Proceeding of the 11th annual international conference on Mobile systems, applications, and services
Trade area analysis using user generated mobile location data

Proceedings of the 22nd international conference on World Wide Web
CoenoFire: monitoring performance indicators of firefighters in real-world missions using smartphones

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
It takes a network to get dinner: designing location-based systems to address local food needs

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Understanding the coverage and scalability of place-centric crowdsensing

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
FaceLog: capturing user's everyday face using mobile devices

Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
Investigating mobile crowdsensing application performance

Proceedings of the third ACM international symposium on Design and analysis of intelligent vehicular networks and applications
FOCUS: clustering crowdsourced videos by line-of-sight

Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
iDiary: from GPS signals to a text-searchable diary

Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
Piggyback CrowdSensing (PCS): energy efficient crowdsourcing of mobile sensor data by exploiting smartphone app opportunities

Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
iMac: strategy-proof incentive mechanism for mobile crowdsourcing

WASA'13 Proceedings of the 8th international conference on Wireless Algorithms, Systems, and Applications
Feature engineering for semantic place prediction

Pervasive and Mobile Computing
Local business ambience characterization through mobile audio sensing

Proceedings of the 23rd international conference on World wide web
SpinRadar: a spontaneous service provision middleware for place-aware social interactions

Personal and Ubiquitous Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Automated and scalable approaches for understanding the semantics of places are critical to improving both existing and emerging mobile services. In this paper, we present CrowdSense@Place (CSP), a framework that exploits a previously untapped resource -- opportunistically captured images and audio clips from smartphones -- to link place visits with place categories (e.g., store, restaurant). CSP combines signals based on location and user trajectories (using WiFi/GPS) along with various visual and audio place "hints" mined from opportunistic sensor data. Place hints include words spoken by people, text written on signs or objects recognized in the environment. We evaluate CSP with a seven-week, 36-user experiment involving 1,241 places in five locations around the world. Our results show that CSP can classify places into a variety of categories with an overall accuracy of 69%, outperforming currently available alternative solutions.