Sensor-based understanding of daily life via large-scale use of common sense

  • Authors:
  • William Pentney;Ana-Maria Popescu;Shiaokai Wang;Henry Kautz;Matthai Philipose

  • Affiliations:
  • Department of Computer Science & Engineering, University of Washington, Seattle, WA;Department of Computer Science & Engineering, University of Washington, Seattle, WA;Department of Computer Science & Engineering, University of Washington, Seattle, WA;Department of Computer Science & Engineering, University of Washington, Seattle, WA;Intel Research Seattle, Seattle, WA

  • Venue:
  • AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The use of large quantities of common sense has long been thought to be critical to the automated understanding of the world. To this end, various groups have collected repositories of common sense in machine-readable form. However, efforts to apply these large bodies of knowledge to enable correspondingly large-scale sensor-based understanding of the world have been few. Challenges have included semantic gaps between facts in the repositories and phenomena detected by sensors, fragility of reasoning in the face of noise, incompleteness of repositories, and slowness of reasoning with these large repositories. We show how to address these problems with a combination of novel sensors, probabilistic representation, web-scale information retrieval and approximate reasoning. In particular, we show how to use the 50,000-fact hand-entered Open-Mind Indoor Common Sense database to interpret sensor traces of day-to-day activities with 88% accuracy (which is easy) and 32/53% precision/recall (which is not).