Tapping into unstructured data: integrating unstructured data and textual analytics into business intelligence

• Authors: William Inmon;Anthony Nesavich
• Venue: Tapping into unstructured data: integrating unstructured data and textual analytics into business intelligence
• Year: 2007

“The authors, the best minds on the topic, are breaking new ground. They show how every organization can realize the benefits of a system that can search and present complex ideas or data from what has been a mostly untapped source of raw data.”--Randy Chalfant, CTO, Sun MicrosystemsThe Definitive Guide to Unstructured Data Management and Analysis--From the World's Leading Information Management ExpertA wealth of invaluable information exists in unstructured textual form, but organizations have found it difficult or impossible to access and utilize it. This is changing rapidly: new approaches finally make it possible to glean useful knowledge from virtually any collection of unstructured data.William H. Inmon--the father of data warehousing--and Anthony Nesavich introduce the next data revolution: unstructured data management. Inmon and Nesavich cover all you need to know to make unstructured data work for your organization. You'll learn how to bring it into your existing structured data environment, leverage existing analytical infrastructure, and implement textual analytic processing technologies to solve new problems and uncover new opportunities. Inmon and Nesavich introduce breakthrough techniques covered in no other book--including the powerful role of textual integration, new ways to integrate textual data into data warehouses, and new SQL techniques for reading and analyzing text. They also present five chapter-length, real-world case studies--demonstrating unstructured data at work in medical research, insurance, chemical manufacturing, contracting, and beyond.This book will be indispensable to every business and technical professional trying to make sense of a large body of unstructured text: managers, database designers, data modelers, DBAs, researchers, and end users alike.Coverage includes What unstructured data is, and how it differs from structured data First generation technology for handling unstructured data, from search engines to ECM--and its limitations Integrating text so it can be analyzed with a common, colloquial vocabulary: integration engines, ontologies, glossaries, and taxonomies Processing semistructured data: uncovering patterns, words, identifiers, and conflicts Novel processing opportunities that arise when text is freed from context Architecture and unstructured data: Data Warehousing 2.0 Building unstructured relational databases and linking them to structured data Visualizations and Self-Organizing Maps (SOMs), including Compudigm and Raptor solutions Capturing knowledge from spreadsheet data and email Implementing and managing metadata: data models, data quality, and more William H. Inmon is founder, president, and CTO of Inmon Data Systems. He is the father of the data warehouse concept, the corporate information factory, and the government information factory. Inmon has written 47 books on data warehouse, database, and information technology management; as well as more than 750 articles for trade journals such as Data Management Review, Byte, Datamation, and ComputerWorld. His b-eye-network.com newsletter currently reaches 55,000 people.Anthony Nesavich worked at Inmon Data Systems, where he developed multiple reports that successfully query unstructured data.Preface xvii 1ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Unstructured Textual Data in the Organization 1 2ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 The Environments of Structured Data and Unstructured Data 15 3ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 First Generation Textual Analytics 33 4ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Integrating Unstructured Text into the Structured Environment 47 5ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Semistructured Data 73 6ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Architecture and Textual Analytics 83 7ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 The Unstructured Database 95 8ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Analyzing a Combination of Unstructured Data and Structured Data 113 9ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Analyzing Text Through Visualization 12710ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Spreadsheets and Email 13511ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Metadata in Unstructured Data 14712ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 A Methodology for Textual Analytics 16313ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Merging Unstructured Databases into the Data Warehouse 17514ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Using SQL to Analyze Text 18515ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Case Study--Textual Analytics in Medical Research 19516ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Case Study--A Database for Harmful Chemicals 20317ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Case Study--Managing Contracts Through an Unstructured Database 20918ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Case Study--Creating a Corporate Taxonomy (Glossary) 21519ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 ï戮 Case Study--Insurance Claims 219Glossary 227Index 233