Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval
ECML '98 Proceedings of the 10th European Conference on Machine Learning
Ontology Matching
PORSCHE: Performance ORiented SCHEma mediation
Information Systems
Effective Web Service Composition in Diverse and Large-Scale Service Networks
IEEE Transactions on Services Computing
Large-Scale Network Decomposition and Mathematical Programming Based Web Service Composition
CEC '09 Proceedings of the 2009 IEEE Conference on Commerce and Enterprise Computing
Graph Theoretic Topological Analysis of Web Service Networks
World Wide Web
Cost-Effective Semantic Annotation of XML Schemas and Web Service Interfaces
SCC '09 Proceedings of the 2009 IEEE International Conference on Services Computing
Power-Law Distributions in Empirical Data
SIAM Review
Ontology learning for cost-effective large-scale semantic annotation of web service interfaces
EKAW'10 Proceedings of the 17th international conference on Knowledge engineering and management by the masses
Automatic interpretation of noun compounds using wordnet similarity
IJCNLP'05 Proceedings of the Second international joint conference on Natural Language Processing
Bootstrapping Ontologies for Web Services
IEEE Transactions on Services Computing
Exploring information diffusion in network of semantically annotated web service interfaces
Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics
Semantic annotation: what about quality?
Proceedings of the fifth workshop on Exploiting semantic annotations in information retrieval
| Hi-index | 0.00 |
In recent years many methods have been proposed, which require semantic annotations of Web services as an input. Such methods include discovery, match-making, composition and execution of Web services in dynamic settings, just to mention few. At the same time automated Web service annotation approaches have been proposed for supporting application of former methods in settings where it is not feasible to provide the annotations manually. However, lack of effective automated evaluation frameworks has seriously limited proper evaluation of the constructed annotations in practical settings where the overall annotation quality of millions of Web services needs to be evaluated. This paper describes an evaluation framework for measuring the quality of semantic annotations of large number of Web services descriptions provided in form of WSDL and XSD documents. The evaluation framework is based on analyzing network properties, namely scale-free and small-world properties, of Web service networks, which in turn have been constructed from semantic annotations of Web services. The evaluation approach is demonstrated through evaluation of a semi-automated annotation approach, which was applied to a set of publicly available WSDL documents describing altogether ca 200 000 Web service operations.