Evaluation of a Semi-Automated Semantic Annotation Approach for Bootstrapping the Analysis of Large-scale Web Service Networks
2011 (English)In: International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), 2011 IEEE/WIC/ACM, IEEE Computer Society, 2011, 388-395 p.Conference paper (Refereed)
In recent years many methods have been proposed, which require semantic annotations of Web services as an input. Such methods include discovery, match-making, composition and execution of Web services in dynamic settings, just to mention few. At the same time automated Web service annotation approaches have been proposed for supporting application of former methods in settings where it is not feasible to provide the annotations manually. However, lack of effective automated evaluation frameworks has seriously limited proper evaluation of the constructed annotations in practical settings where the overall annotation quality of millions of Web services needs to be evaluated. This paper describes an evaluation framework for measuring the quality of semantic annotations of large number of Web services descriptions provided in form of WSDL and XSD documents. The evaluation framework is based on analyzing network properties, namely scale-free and small-world properties, of Web service networks, which in turn have been constructed from semantic annotations of Web services. The evaluation approach is demonstrated through evaluation of a semi-automated annotation approach, which was applied to a set of publicly available WSDL documents describing altogether ca 200 000 Web service operations.
Place, publisher, year, edition, pages
IEEE Computer Society, 2011. 388-395 p.
WSDL, Web service annotation, Web service network, XSD
IdentifiersURN: urn:nbn:se:kth:diva-83866DOI: 10.1109/WI-IAT.2011.237ScopusID: 2-s2.0-80155129497ISBN: 978-1-4577-1373-6OAI: oai:DiVA.org:kth-83866DiVA: diva2:499170
Web Intelligence and Intelligent Agent Technology, 22-27 Aug. 2011, Lyon
© 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
QC 201202152012-02-152012-02-132012-02-15Bibliographically approved