Fundamentals of speech recognition
Fundamentals of speech recognition
An overview of audio information retrieval
Multimedia Systems - Special issue on audio and multimedia
Classification of general audio data for content-based retrieval
Pattern Recognition Letters - Special issue on image/video indexing and retrieval
Comparison of different implementations of MFCC
Journal of Computer Science and Technology
Construction and Evaluation of a Robust Multifeature Speech/Music Discriminator
ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 2 - Volume 2
Sensing and modeling human networks
Sensing and modeling human networks
Acoustic environment as an indicator of social and physical context
Personal and Ubiquitous Computing
Acoustic environment classification
ACM Transactions on Speech and Language Processing (TSLP)
Pattern Recognition and Machine Learning (Information Science and Statistics)
Pattern Recognition and Machine Learning (Information Science and Statistics)
Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields
International Journal of Robotics Research
WICON '06 Proceedings of the 2nd annual international workshop on Wireless internet
Real-time discrimination of broadcast speech/music
ICASSP '96 Proceedings of the Acoustics, Speech, and Signal Processing, 1996. on Conference Proceedings., 1996 IEEE International Conference - Volume 02
IEEE Pervasive Computing
Peopletones: a system for the detection and notification of buddy proximity on mobile phones
Proceedings of the 6th international conference on Mobile systems, applications, and services
The Mobile Sensing Platform: An Embedded Activity Recognition System
IEEE Pervasive Computing
Lifelogging memory appliance for people with episodic memory impairment
UbiComp '08 Proceedings of the 10th international conference on Ubiquitous computing
Proceedings of the 6th ACM conference on Embedded network sensor systems
Analysis of chewing sounds for dietary monitoring
UbiComp'05 Proceedings of the 7th international conference on Ubiquitous Computing
Learning and predicting multimodal daily life patterns from cell phones
Proceedings of the 2009 international conference on Multimodal interfaces
Enabling pervasive mobile applications with the FM radio broadcast data system
Proceedings of the Eleventh Workshop on Mobile Computing Systems & Applications
Enabling energy efficient continuous sensing on mobile phones with LittleRock
Proceedings of the 9th ACM/IEEE International Conference on Information Processing in Sensor Networks
Darwin phones: the evolution of sensing and inference on mobile phones
Proceedings of the 8th international conference on Mobile systems, applications, and services
CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones
Proceedings of the 8th international conference on Mobile systems, applications, and services
Improving energy efficiency of location sensing on smartphones
Proceedings of the 8th international conference on Mobile systems, applications, and services
MoVi: mobile phone based video highlights via collaborative sensing
Proceedings of the 8th international conference on Mobile systems, applications, and services
Prisense: privacy-preserving data aggregation in people-centric urban sensing systems
INFOCOM'10 Proceedings of the 29th conference on Information communications
Road traffic estimation using in-situ acoustic sensing
Proceedings of the ACM SIGCOMM 2010 conference
Challenges in ubiquitous context recognition with personal mobile devices
Proceedings of the 4th ACM International Workshop on Context-Awareness for Self-Managing Systems
EmotionSense: a mobile phones based adaptive platform for experimental social psychology research
Proceedings of the 12th ACM international conference on Ubiquitous computing
Acoustic source localization of everyday sounds using wireless sensor networks
Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - Adjunct
A survey of mobile phone sensing
IEEE Communications Magazine
SensLoc: sensing everyday places and paths using less energy
Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems
The Jigsaw continuous sensing engine for mobile phone applications
Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems
eShare: a capacitor-driven energy storage and sharing network for long-term operation
Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems
Code in the air: simplifying sensing on smartphones
Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems
Effect of noise-in-speech on MFCC parameters
SSIP '09/MIV'09 Proceedings of the 9th WSEAS international conference on signal, speech and image processing, and 9th WSEAS international conference on Multimedia, internet & video technologies
Fast, accurate event classification on resource-lean embedded sensors
EWSN'11 Proceedings of the 8th European conference on Wireless sensor networks
Nonverbal acoustic communication in human-computer interaction
Artificial Intelligence Review
Short paper: PEPSI---privacy-enhanced participatory sensing infrastructure
Proceedings of the fourth ACM conference on Wireless network security
TagSense: a smartphone-based approach to automatic image tagging
MobiSys '11 Proceedings of the 9th international conference on Mobile systems, applications, and services
FindingMiMo: tracing a missing mobile phone using daily observations
MobiSys '11 Proceedings of the 9th international conference on Mobile systems, applications, and services
Indoor localization without infrastructure using the acoustic background spectrum
MobiSys '11 Proceedings of the 9th international conference on Mobile systems, applications, and services
SpeakerSense: energy efficient unobtrusive speaker identification on mobile phones
Pervasive'11 Proceedings of the 9th international conference on Pervasive computing
Tapping into the Vibe of the city using VibN, a continuous sensing application for smartphones
Proceedings of 1st international symposium on From digital footprints to social and community intelligence
Employing user feedback for semantic location services
Proceedings of the 13th international conference on Ubiquitous computing
Proceedings of the 13th international conference on Ubiquitous computing
Investigating intelligibility for uncertain context-aware applications
Proceedings of the 13th international conference on Ubiquitous computing
A survey on privacy in mobile participatory sensing applications
Journal of Systems and Software
Design of an intelligible mobile context-aware application
Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
Balancing energy, latency and accuracy for mobile sensor data classification
Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
CarMA: towards personalized automotive tuning
Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
PBN: towards practical activity recognition using smartphone-based body sensor networks
Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems
mConverse: inferring conversation episodes from respiratory measurements collected in the field
Proceedings of the 2nd Conference on Wireless Health
Pressentials: a flexible middleware for presence-enabled applications
IPTcomm '11 Proceedings of the 5th International Conference on Principles, Systems and Applications of IP Telecommunications
Reflex: using low-power processors in smartphones without knowing them
ASPLOS XVII Proceedings of the seventeenth international conference on Architectural Support for Programming Languages and Operating Systems
Code in the air: simplifying sensing and coordination tasks on smartphones
Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications
Preserving query privacy in urban sensing systems
ICDCN'12 Proceedings of the 13th international conference on Distributed Computing and Networking
Achieving long-term operation with a capacitor-driven energy storage and sharing network
ACM Transactions on Sensor Networks (TOSN)
Android genetic programming framework
EuroGP'12 Proceedings of the 15th European conference on Genetic Programming
Web squared: paradigms and opportunities
Proceedings of the 5th International ICST Conference on Simulation Tools and Techniques
ACE: exploiting correlation for energy-efficient and continuous context sensing
Proceedings of the 10th international conference on Mobile systems, applications, and services
CoMon: cooperative ambience monitoring platform with continuity and benefit awareness
Proceedings of the 10th international conference on Mobile systems, applications, and services
Medusa: a programming framework for crowd-sensing applications
Proceedings of the 10th international conference on Mobile systems, applications, and services
How long to wait?: predicting bus arrival time with mobile phone based participatory sensing
Proceedings of the 10th international conference on Mobile systems, applications, and services
Collecting big datasets of human activity one checkin at a time
Proceedings of the 4th ACM international workshop on Hot topics in planet-scale measurement
VISION: cloud-powered sight for all: showing the cloud what you see
Proceedings of the third ACM workshop on Mobile cloud computing and services
Proceedings of the 6th International Conference on Body Area Networks
The Design and Evaluation of Task Assignment Algorithms for GWAP-based Geospatial Tagging Systems
Mobile Networks and Applications
Gibraltar: exposing hardware devices to web pages using AJAX
WebApps'12 Proceedings of the 3rd USENIX conference on Web Application Development
Sense and sensibility in a pervasive world
Pervasive'12 Proceedings of the 10th international conference on Pervasive Computing
Environmental sound recognition by measuring significant changes in the spectral entropy
MCPR'12 Proceedings of the 4th Mexican conference on Pattern Recognition
Improving energy efficiency of personal sensing applications with heterogeneous multi-processors
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
BodyScope: a wearable acoustic sensor for activity recognition
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Activity recognition using a spectral entropy signature
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Deanonymizing mobility traces: using social network as a side-channel
Proceedings of the 2012 ACM conference on Computer and communications security
A case for automatic sharing over social networks
Proceedings of the First ACM International Workshop on Hot Topics on Interdisciplinary Social Networks Research
Exploring user preferences for privacy interfaces in mobile sensing applications
Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia
Twitter in disaster mode: opportunistic communication and distribution of sensor data in emergencies
Proceedings of the 3rd Extreme Conference on Communication: The Amazon Expedition
Cloud-enabled privacy-preserving collaborative learning for mobile sensing
Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems
IODetector: a generic service for indoor outdoor detection
Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems
Low cost crowd counting using audio tones
Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems
SymPhoney: a coordinated sensing flow execution engine for concurrent mobile sensing applications
Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems
International Journal of Technology Enhanced Learning
Using mobile phone sensors to detect driving behavior
Proceedings of the 3rd ACM Symposium on Computing for Development
Proceedings of the 14th Workshop on Mobile Computing Systems and Applications
Lowering the barriers to large-scale mobile crowdsensing
Proceedings of the 14th Workshop on Mobile Computing Systems and Applications
Spartacus: spatially-aware interaction for mobile devices through energy-efficient audio sensing
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
NuActiv: recognizing unseen new activities using semantic attribute-based learning
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
Auditeur: a mobile-cloud service platform for acoustic event detection on smartphones
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
SocioPhone: everyday face-to-face interaction monitoring platform using multi-phone sensor fusion
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
A survey on smartphone-based systems for opportunistic user context recognition
ACM Computing Surveys (CSUR)
Fast, Accurate Event Classification on Resource-Lean Embedded Sensors
ACM Transactions on Autonomous and Adaptive Systems (TAAS)
Your reactions suggest you liked the movie: automatic content rating via reaction sensing
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Inferring human mobility patterns from taxicab location traces
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Understanding the coverage and scalability of place-centric crowdsensing
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Stop questioning me!: towards optimizing user involvement during data collection on mobile devices
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Robust voice activity detection for social sensing
Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
A tutorial on human activity recognition using body-worn inertial sensors
ACM Computing Surveys (CSUR)
iSleep: unobtrusive sleep quality monitoring using smartphones
Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
International Journal of Ad Hoc and Ubiquitous Computing
Estimation of interruptibility during office work based on PC activity and conversation
HCI'13 Proceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction for learning, culture, collaboration and business - Volume Part III
Unobtrusive sleep monitoring using smartphones
Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare
Proceedings of International Conference on Advances in Mobile Computing & Multimedia
A mobile crowdsensing system enhanced by cloud-based social networking services
Proceedings of the First International Workshop on Middleware for Cloud-enabled Sensing
Towards scalable activity recognition: adapting zero-effort crowdsourced acoustic models
Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia
Cicada fingerprinting system: from artificial to sustainable
Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia
Local business ambience characterization through mobile audio sensing
Proceedings of the 23rd international conference on World wide web
Service-oriented middleware for large-scale mobile participatory sensing
Pervasive and Mobile Computing
Personal and Ubiquitous Computing
ipShield: a framework for enforcing context-aware privacy
NSDI'14 Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation
Hi-index | 0.00 |
Top end mobile phones include a number of specialized (e.g., accelerometer, compass, GPS) and general purpose sensors (e.g., microphone, camera) that enable new people-centric sensing applications. Perhaps the most ubiquitous and unexploited sensor on mobile phones is the microphone - a powerful sensor that is capable of making sophisticated inferences about human activity, location, and social events from sound. In this paper, we exploit this untapped sensor not in the context of human communications but as an enabler of new sensing applications. We propose SoundSense, a scalable framework for modeling sound events on mobile phones. SoundSense is implemented on the Apple iPhone and represents the first general purpose sound sensing system specifically designed to work on resource limited phones. The architecture and algorithms are designed for scalability and Soundsense uses a combination of supervised and unsupervised learning techniques to classify both general sound types (e.g., music, voice) and discover novel sound events specific to individual users. The system runs solely on the mobile phone with no back-end interactions. Through implementation and evaluation of two proof of concept people-centric sensing applications, we demostrate that SoundSense is capable of recognizing meaningful sound events that occur in users' everyday lives.