Beyond the vision paradigm: design strategies for crossmodal interaction with dynamic digital displays

Authors:
Claude Fortin;Kate Hennessy;Ruedi Baur;Pierre Fortin
Affiliations:
Simon Fraser University, Surrey, BC, Canada;Simon Fraser University, Surrey, BC, Canada;Partenariat du Quartier des spectacles, Montréal, Québec, Canada;Partenariat du Quartier des spectacles, Montréal, Québec, Canada
Venue:
Proceedings of the 2nd ACM International Symposium on Pervasive Displays
Year:
2013

Citing 16
Cited 1

Affordance, conventions, and design

interactions
Where the action is: the foundations of embodied interaction

Where the action is: the foundations of embodied interaction
Aesthetic interaction: a pragmatist's aesthetics of interactive systems

DIS '04 Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques
Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users

Proceedings of the 17th annual ACM symposium on User interface software and technology
Designing the spectator experience

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The rotating compass: a novel interaction technique for mobile navigation

CHI '05 Extended Abstracts on Human Factors in Computing Systems
The context of work

Human-Computer Interaction
Supporting transitions in work: informing large display application design by understanding whiteboard use

Proceedings of the ACM 2009 international conference on Supporting group work
Texturing the "material turn" in interaction design

Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction
Sticky tools: full 6DOF force-based interaction for multi-touch tables

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Proxemic interactions: the new ubicomp?

interactions
Chained displays: configurations of public displays can be used to influence actor-, audience-, and passer-by behavior

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Affordances in HCI: toward a mediated action perspective

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
"Material interactions": from atoms & bits to entangled practices

CHI '12 Extended Abstracts on Human Factors in Computing Systems
The role of context in media architecture

Proceedings of the 2012 International Symposium on Pervasive Displays
PaperVideo: interacting with videos on multiple paper-like displays

Proceedings of the 20th ACM international conference on Multimedia

Medium-specific properties of urban screens: towards an ontological framework for digital public displays

Proceedings of the 9th ACM Conference on Creativity & Cognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

The purpose of our research is to develop new interaction paradigms for dynamic digital displays (DDDs) in public space. Our lab is currently developing an ontological framework that comprises seven different interaction paradigms for DDDs. Still in its budding stages, this framework is intended to assist HCI practitioners in the conception and evaluation of architectural scale DDD installations. This paper theoretically discusses crossmodal interaction as one of these seven interaction paradigms. We used an architectural approach that draws on medium specificity --- a fine arts concept foreign to HCI --- to conduct a phenomenological analysis of DDDs that have been deployed in an actual public space in Montréal, Canada. After interviewing DDD design artists and performing our preliminary observational analyses, we found four design strategies that were used to produce crossmodal interaction on an architectural scale, helping shift the experience of DDDs beyond the vision paradigm.