A comparison of input devices in element pointing and dragging tasks
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A model for compound type changes encountered in schema evolution
ACM Transactions on Database Systems (TODS)
XOO7: applying OO7 benchmark to XML query processing tool
Proceedings of the tenth international conference on Information and knowledge management
Data integration: a theoretical perspective
Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
ToXgene: a template-based data generator for XML
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
XPERANTO: Middleware for Publishing Object-Relational Data as XML Documents
VLDB '00 Proceedings of the 26th International Conference on Very Large Data Bases
The Michigan Benchmark: A Microbenchmark for XML Query Processing Systems
Proceedings of the VLDB 2002 Workshop EEXTT and CAiSE 2002 Workshop DTWeb on Efficiency and Effectiveness of XML Tools and Techniques and Data Integration over the Web-Revised Papers
XMach-1: A Benchmark for XML Data Management
Datenbanksysteme in Büro, Technik und Wissenschaft (BTW), 9. GI-Fachtagung,
Efficiently publishing relational data as XML documents
The VLDB Journal — The International Journal on Very Large Data Bases
A survey of approaches to automatic schema matching
The VLDB Journal — The International Journal on Very Large Data Bases
XBench Benchmark and Performance Testing of XML DBMSs
ICDE '04 Proceedings of the 20th International Conference on Data Engineering
Schema mediation for large-scale semantic data sharing
The VLDB Journal — The International Journal on Very Large Data Bases
THALIA: Test Harness for the Assessment of Legacy Information Integration Approaches
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Schema mappings, data exchange, and metadata management
Proceedings of the twenty-fourth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Clio grows up: from research prototype to industrial tool
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
XQBE (XQuery By Example): A visual interface to the standard XML query language
ACM Transactions on Database Systems (TODS)
Semantic adaptation of schema mappings when schemas evolve
VLDB '05 Proceedings of the 31st international conference on Very large data bases
Data delivery in a service-oriented world: the BEA aquaLogic data services platform
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
XML Mapping technology: making connections in an XML-centric world
IBM Systems Journal
Implementing mapping composition
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Debugging schema mappings with routes
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
An approach to the benchmark development for data exchange tools
DBA'06 Proceedings of the 24th IASTED international conference on Database and applications
eTuner: tuning schema matching software using synthetic scenarios
The VLDB Journal — The International Journal on Very Large Data Bases
Model management 2.0: manipulating richer mappings
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
XMark: a benchmark for XML data management
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Mapping adaptation under evolving schemas
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
XBenchMatch: a benchmark for XML schema matching tools
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Schema mapping verification: the spicy way
EDBT '08 Proceedings of the 11th international conference on Extending database technology: Advances in database technology
Comparing and evaluating mapping systems with STBenchmark
Proceedings of the VLDB Endowment
Clip: a Visual Language for Explicit Schema Mappings
ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
Beauty and the beast: the theory and practice of information integration
ICDT'07 Proceedings of the 11th international conference on Database Theory
Bidirectional Transformations: A Cross-Discipline Perspective
ICMT '09 Proceedings of the 2nd International Conference on Theory and Practice of Model Transformations
Clio: Schema Mapping Creation and Data Exchange
Conceptual Modeling: Foundations and Applications
Detection of corrupted schema mappings in XML data integration systems
ACM Transactions on Internet Technology (TOIT)
Schema mapping and query translation in heterogeneous P2P XML databases
The VLDB Journal — The International Journal on Very Large Data Bases
Characterizing schema mappings via data examples
Proceedings of the twenty-ninth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Graphical XQuery in the aqualogic data services platform
Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Proceedings of the First International Workshop on Model-Driven Interoperability
Surviving the heterogeneity jungle with composite mapping operators
ICMT'10 Proceedings of the Third international conference on Theory and practice of model transformations
TRAMP: understanding the behavior of schema mappings through provenance
Proceedings of the VLDB Endowment
Just-in-time data integration in action
Proceedings of the VLDB Endowment
Schema matching and mapping: from usage to evaluation
Proceedings of the 14th International Conference on Extending Database Technology
Leveraging query logs for schema mapping generation in U-MAP
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Designing and refining schema mappings via data examples
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
From the heterogeneity jungle to systematic benchmarking
MODELS'10 Proceedings of the 2010 international conference on Models in software engineering
Benchmarking matching applications on the semantic Web
ESWC'11 Proceedings of the 8th extended semantic web conference on The semanic web: research and applications - Volume Part II
Ontology alignment evaluation initiative: six years of experience
Journal on data semantics XV
Characterizing schema mappings via data examples
ACM Transactions on Database Systems (TODS)
Plug & play model transformations: a DSL for resolving structural metamodel heterogeneities
Proceedings of the 10th Workshop on Domain-Specific Modeling
On benchmarking data translation systems for semantic-web ontologies
Proceedings of the 20th ACM international conference on Information and knowledge management
Spreadsheet-based complex data transformation
Proceedings of the 20th ACM international conference on Information and knowledge management
Matching and alignment: what is the cost of user post-match effort?
OTM'11 Proceedings of the 2011th Confederated international conference on On the move to meaningful internet systems - Volume Part I
Generating SPARQL executable mappings to integrate ontologies
ER'11 Proceedings of the 30th international conference on Conceptual modeling
Merging relational views: a minimization approach
ER'11 Proceedings of the 30th international conference on Conceptual modeling
Evolution and change management of XML-based systems
Journal of Systems and Software
101companies: a community project on software technologies and software languages
TOOLS'12 Proceedings of the 50th international conference on Objects, Models, Components, Patterns
What is the IQ of your data transformation system?
Proceedings of the 21st ACM international conference on Information and knowledge management
Schema mappings and data examples
Proceedings of the 16th International Conference on Extending Database Technology
Value invention in data exchange
Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
MostoDE: A tool to exchange data amongst semantic-web ontologies
Journal of Systems and Software
MatchBench: benchmarking schema matching algorithms for schematic correspondences
BNCOD'13 Proceedings of the 29th British National conference on Big Data
| Hi-index | 0.00 |
A fundamental problem in information integration is to precisely specify the relationships, called mappings, between schemas. Designing mappings is a time-consuming process. To alleviate this problem, many mapping systems have been developed to assist the design of mappings. However, a benchmark for comparing and evaluating these systems has not yet been developed. We present STBenchmark, a solution towards a much needed benchmark for mapping systems. We first describe the challenges that are unique to the development of benchmarks for mapping systems. After this, we describe the three components of STBenchmark: (1) a basic suite of mapping scenarios that we believe represents a minimum set of transformations that should be readily supported by any mapping system, (2) a mapping scenario generator as well as an instance generator that can produce complex mapping scenarios and, respectively, instances of varying sizes of a given schema, (3) a simple usability model that can be used as a first-cut measure on the case of use of a mapping system. We use STBenchmark to evaluate four mapping systems and report our results, as well as describe some interesting observations.