Plans and situated actions: the problem of human-machine communication
Plans and situated actions: the problem of human-machine communication
Development of the domain name system
SIGCOMM '88 Symposium proceedings on Communications architectures and protocols
IP-based protocols for mobile internetworking
SIGCOMM '91 Proceedings of the conference on Communications architecture & protocols
The context toolkit: aiding the development of context-enabled applications
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction with mobile systems
ConChat: A Context-Aware Chat Program
IEEE Pervasive Computing
Content-Based Classification, Search, and Retrieval of Audio
IEEE MultiMedia
The Wearable Computer as a Remote Interface for People with Disabilities
ISWC '97 Proceedings of the 1st IEEE International Symposium on Wearable Computers
The wearable remembrance agent: a system for augmented memory
ISWC '97 Proceedings of the 1st IEEE International Symposium on Wearable Computers
ISWC '97 Proceedings of the 1st IEEE International Symposium on Wearable Computers
Extracting Context from Environmental Audio
ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
Visual Contextual Awareness in Wearable Computing
ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
Adding Generic Contextual Capabilities to Wearable Computers
ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
Proceedings of the 1st IEEE/ACM/IFIP international conference on Hardware/software codesign and system synthesis
Context-Aware Computing Applications
WMCSA '94 Proceedings of the 1994 First Workshop on Mobile Computing Systems and Applications
Is the contextual information relevant in text clustering by compression?
Expert Systems with Applications: An International Journal
| Hi-index | 0.00 |
In this paper we describe the design concepts and prototype implementation of a situation aware ubiquitous computing system using multiple modalities such as National Marine Electronics Association (NMEA) data from global positioning system (GPS) receivers, text, speech, environmental audio, and handwriting inputs. While most mobile and communication devices know where and who they are, by accessing context information primarily in the form of location, time stamps, and user identity, the concept of sharing of this information in a reliable and intelligent fashion is crucial in many scenarios. A framework which takes the concept of context aware computing to the level of situation aware computing by intelligent information exchange between context aware devices is designed and implemented in this work. Four sensual modes of contextual information like text, speech, environmental audio, and handwriting are augmented to conventional contextual information sources like location from GPS, user identity based on IP addresses (IPA), and time stamps. Each device derives its context not necessarily using the same criteria or parameters but by employing selective fusion and fission of multiple modalities. The processing of each individual modality takes place at the client device followed by the summarization of context as a text file. Exchange of dynamic context information between devices is enabled in real time to create multimodal situation aware devices. A central repository of all user context profiles is also created to enable self-learning devices in the future. Based on the results of simulated situations and real field deployments it is shown that the use of multiple modalities like speech, environmental audio, and handwriting inputs along with conventional modalities can create devices with enhanced situational awareness.