A task-oriented approach to information retrieval evaluation
Journal of the American Society for Information Science - Special issue: evaluation of information retrieval systems
Data warehousing in an integrated health system: building the business case
Proceedings of the 1st ACM international workshop on Data warehousing and OLAP
What happened when database researchers met usability
Information Systems
Experience Using TSQL2 in a Natural Language Interface
Proceedings of the International Workshop on Temporal Databases: Recent Advances in Temporal Databases
Visual Query Systems: A Taxonomy
Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II
Querying temporal databases using controlled natural language
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 2
INFER: a relational query language without the complexity of SQL
Proceedings of the 14th ACM international conference on Information and knowledge management
Use of Workflow Technology Tools to Analyze Medical Data
CBMS '06 Proceedings of the 19th IEEE Symposium on Computer-Based Medical Systems
Examining the technology acceptance model using physician acceptance of telemedicine technology
Journal of Management Information Systems - Special section: Strategic and competitive information systems
Evaluation Methods in Biomedical Informatics (Health Informatics)
Evaluation Methods in Biomedical Informatics (Health Informatics)
CBMS '07 Proceedings of the Twentieth IEEE International Symposium on Computer-Based Medical Systems
Analyzing biomedical data sets using executable graphical models
Analyzing biomedical data sets using executable graphical models
Methodological Review: The Technology Acceptance Model: Its past and its future in health care
Journal of Biomedical Informatics
Information interchange services for electronic health record databases
International Journal of Computational Science and Engineering
Proceedings of the ACM SIGKDD Workshop on Interactive Data Exploration and Analytics
| Hi-index | 0.00 |
Provision of query systems which are intuitive for non-experts has been recognized as an important informatics challenge. We developed a prototype of a flowchart-based analytical framework called RetroGuide that enables non-experts to formulate query tasks using a step-based, patient-centered paradigm inspired by workflow technology. We present results of the evaluation of RetroGuide in comparison to Structured Query Language (SQL) in laboratory settings using a mixed method design. We asked 18 human subjects with limited database experience to solve query tasks in RetroGuide and SQL, and quantitatively compared their test scores. A follow-up questionnaire was designed to compare both technologies qualitatively and investigate RetroGuide technology acceptance. The quantitative comparison of test scores showed that the study subjects achieved significantly higher scores using the RetroGuide technology. Qualitative study results indicated that 94% of subjects preferred RetroGuide to SQL because RetroGuide was easier to learn, it better supported temporal tasks, and it seemed to be a more logical modeling paradigm. Additional qualitative evaluation results, based on a technology acceptance model, suggested that a fully developed RetroGuide-like technology would be well accepted by users. Our study is an example of a structure validation study of a prototype query system, results of which provided significant guidance in further development of a novel query paradigm for EHR data. We discuss the strengths and weakness of our study design and results, and their implication for future evaluations of query systems in general.