WordNet: a lexical database for English
Communications of the ACM
Evaluation by highly relevant documents
Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Using Multiple Clause Constructors in Inductive Logic Programming for Semantic Parsing
EMCL '01 Proceedings of the 12th European Conference on Machine Learning
Advances in Open Domain Question Answering (Text, Speech and Language Technology)
Advances in Open Domain Question Answering (Text, Speech and Language Technology)
Proceedings of the 12th international conference on Intelligent user interfaces
Composing Questions through Conceptual Authoring
Computational Linguistics
AquaLog: An ontology-driven question answering system for organizational semantic intranets
Web Semantics: Science, Services and Agents on the World Wide Web
PANTO: A Portable Natural Language Interface to Ontologies
ESWC '07 Proceedings of the 4th European conference on The Semantic Web: Research and Applications
DBpedia - A crystallization point for the Web of Data
Web Semantics: Science, Services and Agents on the World Wide Web
C-Phrase: A system for building robust natural language interfaces to databases
Data & Knowledge Engineering
How useful are natural language interfaces to the semantic web for casual end-users?
ISWC'07/ASWC'07 Proceedings of the 6th international The semantic web and 2nd Asian conference on Asian semantic web conference
Reflections on five years of evaluating semantic search systems
International Journal of Metadata, Semantics and Ontologies
An easy way of expressing conceptual graph queries from keywords and query patterns
ICCS'10 Proceedings of the 18th international conference on Conceptual structures: from information to intelligence
Scaling up question-answering to linked data
EKAW'10 Proceedings of the 17th international conference on Knowledge engineering and management by the masses
Querying linked data using semantic relatedness: a vocabulary independent approach
NLDB'11 Proceedings of the 16th international conference on Natural language processing and information systems
The state of semantic technology today: overview of the first SEALS evaluation campaigns
Proceedings of the 7th International Conference on Semantic Systems
Natural language interfaces: what is the problem? – a data-driven quantitative analysis
NLDB'09 Proceedings of the 14th international conference on Applications of Natural Language to Information Systems
ESWC'10 Proceedings of the 7th international conference on The Semantic Web: research and Applications - Volume Part I
FREyA: an interactive way of querying linked data using natural language
ESWC'11 Proceedings of the 8th international conference on The Semantic Web
Evaluation of a layered approach to question answering over linked data
ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part II
Hi-index | 0.00 |
The availability of large amounts of open, distributed, and structured semantic data on the web has no precedent in the history of computer science. In recent years, there have been important advances in semantic search and question answering over RDF data. In particular, natural language interfaces to online semantic data have the advantage that they can exploit the expressive power of Semantic Web data models and query languages, while at the same time hiding their complexity from the user. However, despite the increasing interest in this area, there are no evaluations so far that systematically evaluate this kind of systems, in contrast to traditional question answering and search interfaces to document spaces. To address this gap, we have set up a series of evaluation challenges for question answering over linked data. The main goal of the challenge was to get insight into the strengths, capabilities, and current shortcomings of question answering systems as interfaces to query linked data sources, as well as benchmarking how these interaction paradigms can deal with the fact that the amount of RDF data available on the web is very large and heterogeneous with respect to the vocabularies and schemas used. Here, we report on the results from the first and second of such evaluation campaigns. We also discuss how the second evaluation addressed some of the issues and limitations which arose from the first one, as well as the open issues to be addressed in future competitions.