A web-based evaluation framework for spatial instruction-giving systems

Authors:
Srinivasan Janarthanam;Oliver Lemon;Xingkun Liu
Affiliations:
Heriot Watt University, Edinburgh;Heriot Watt University, Edinburgh;Heriot Watt University, Edinburgh
Venue:
ACL '12 Proceedings of the ACL 2012 System Demonstrations
Year:
2012

Citing 9
Cited 1

AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface

Personal and Ubiquitous Computing
CORAL: using natural language generation for navigational assistance

ACSC '03 Proceedings of the 26th Australasian computer science conference - Volume 16
A natural wayfinding exploiting photos in pedestrian navigation systems

Proceedings of the 8th conference on Human-computer interaction with mobile devices and services
A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies

The Knowledge Engineering Review
ONTRACK: Dynamically adapting music playback to support navigation

Personal and Ubiquitous Computing
Simplest Instructions: Finding Easy-to-Describe Routes for Navigation

GIScience '08 Proceedings of the 5th international conference on Geographic Information Science
Landmark-based pedestrian navigation from collections of geotagged photos

Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia
Learning lexical alignment policies for generating referring expressions in spoken dialogue systems

ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
The GRUVE challenge: generating routes under uncertainty in virtual environments

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation

Integrating location, visibility, and question-answering in a spoken dialogue system for pedestrian city exploration

SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue

Quantified Score

Hi-index	0.00

Visualization

Abstract

We demonstrate a web-based environment for development and testing of different pedestrian route instruction-giving systems. The environment contains a City Model, a TTS interface, a game-world, and a user GUI including a simulated street-view. We describe the environment and components, the metrics that can be used for the evaluation of pedestrian route instruction-giving systems, and the shared challenge which is being organised using this environment.