Building, maintaining, and using knowledge bases: a report from the trenches

  • Authors:
  • Omkar Deshpande;Digvijay S. Lamba;Michel Tourn;Sanjib Das;Sri Subramaniam;Anand Rajaraman;Venky Harinarayan;AnHai Doan

  • Affiliations:
  • @WalmartLabs, San Bruno, CA, USA;@WalmartLabs, San Bruno, CA, USA;Google, New York City, NY, USA;University of Wisconsin-Madison, Madison, WI, USA;@WalmartLabs, San Bruno, CA, USA;Formerly at @WalmartLabs, San Bruno, CA, USA;Formerly at @WalmartLabs, San Bruno, CA, USA;@WalmartLabs, San Bruno, CA, USA

  • Venue:
  • Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

A knowledge base (KB) contains a set of concepts, instances, and relationships. Over the past decade, numerous KBs have been built, and used to power a growing array of applications. Despite this flurry of activities, however, surprisingly little has been published about the end-to-end process of building, maintaining, and using such KBs in industry. In this paper we describe such a process. In particular, we describe how we build, update, and curate a large KB at Kosmix, a Bay Area startup, and later at WalmartLabs, a development and research lab of Walmart. We discuss how we use this KB to power a range of applications, including query understanding, Deep Web search, in-context advertising, event monitoring in social media, product search, social gifting, and social mining. Finally, we discuss how the KB team is organized, and the lessons learned. Our goal with this paper is to provide a real-world case study, and to contribute to the emerging direction of building, maintaining, and using knowledge bases for data management applications.