Overview of the second text retrieval conference (TREC-2)
TREC-2 Proceedings of the second conference on Text retrieval conference
The Cranfield tests on index language devices
Readings in information retrieval
The Philosophy of Information Retrieval Evaluation
CLEF '01 Revised Papers from the Second Workshop of the Cross-Language Evaluation Forum on Evaluation of Cross-Language Information Retrieval Systems
Keyword Searching and Browsing in Databases using BANKS
ICDE '02 Proceedings of the 18th International Conference on Data Engineering
SIAM Journal on Discrete Mathematics
Bidirectional expansion for keyword search on graph databases
VLDB '05 Proceedings of the 31st international conference on Very large data bases
Indexing Relational Database Content Offline for Efficient Keyword-Based Search
IDEAS '05 Proceedings of the 9th International Database Engineering & Application Symposium
Effective keyword search in relational databases
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
InfoScale '06 Proceedings of the 1st international conference on Scalable information systems
Spark: top-k keyword query in relational databases
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
BLINKS: ranked keyword searches on graphs
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Discover: keyword search in relational databases
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Efficient IR-style keyword search over relational databases
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Keyword proximity search in complex data graphs
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Novelty and diversity in information retrieval evaluation
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Introduction to Information Retrieval
Introduction to Information Retrieval
Keyword search on external memory data graphs
Proceedings of the VLDB Endowment
STAR: Steiner-Tree Approximation in Relationship Graphs
ICDE '09 Proceedings of the 2009 IEEE International Conference on Data Engineering
Keyword search in databases: the power of RDBMS
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Keyword search on structured and semi-structured data
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
How are we searching the World Wide Web? A comparison of nine search engine transaction logs
Information Processing and Management: an International Journal - Special issue: Formal methods for information retrieval
Structured data retrieval using cover density ranking
Proceedings of the 2nd International Workshop on Keyword Search on Structured Data
The list Viterbi training algorithm and its application to keyword search over databases
Proceedings of the 20th ACM international conference on Information and knowledge management
Ranking support for keyword search on structured data using relevance models
Proceedings of the 20th ACM international conference on Information and knowledge management
Learning to rank results in relational keyword search
Proceedings of the 20th ACM international conference on Information and knowledge management
Language models for keyword search over data graphs
Proceedings of the fifth ACM international conference on Web search and data mining
Towards expressive exploratory search over entity-relationship data
Proceedings of the 21st international conference companion on World Wide Web
STRUCT: incorporating contextual information for English query search on relational databases
KEYS '12 Proceedings of the Third International Workshop on Keyword Search on Structured Data
A personal perspective on keyword search over data graphs
Proceedings of the 16th International Conference on Database Theory
Selectivity estimation for hybrid queries over text-rich data graphs
Proceedings of the 16th International Conference on Extending Database Technology
Converting relational to graph databases
First International Workshop on Graph Data Management Experiences and Systems
Repeatable and reliable semantic search evaluation
Web Semantics: Science, Services and Agents on the World Wide Web
Probabilistic query rewriting for efficient and effective keyword search on graph data
Proceedings of the VLDB Endowment
Hi-index | 0.02 |
With regard to keyword search systems for structured data, research during the past decade has largely focused on performance. Researchers have validated their work using ad hoc experiments that may not reflect real-world workloads. We illustrate the wide deviation in existing evaluations and present an evaluation framework designed to validate the next decade of research in this field. Our comparison of 9 state-of-the-art keyword search systems contradicts the retrieval effectiveness purported by existing evaluations and reinforces the need for standardized evaluation. Our results also suggest that there remains considerable room for improvement in this field. We found that many techniques cannot scale to even moderately-sized datasets that contain roughly a million tuples. Given that existing databases are considerably larger than this threshold, our results motivate the creation of new algorithms and indexing techniques that scale to meet both current and future workloads.