A Middleware for Seamless Use of Multiple Displays

Authors:
Satoshi Sakurai;Yuichi Itoh;Yoshifumi Kitamura;Miguel A. Nacenta;Tokuo Yamaguchi;Sriram Subramanian;Fumio Kishino
Affiliations:
Graduate School of Information Science and Technology, Osaka University, Suita, Japan 565-0871;Graduate School of Information Science and Technology, Osaka University, Suita, Japan 565-0871;Graduate School of Information Science and Technology, Osaka University, Suita, Japan 565-0871;Department of Computer Science, University of Saskatchewan, Saskatoon, Canada S7N 5C9;Graduate School of Information Science and Technology, Osaka University, Suita, Japan 565-0871;Department of Computer Science, University of Bristol, Bristol, United Kingdom BS8 1UB;Graduate School of Information Science and Technology, Osaka University, Suita, Japan 565-0871
Venue:
Interactive Systems. Design, Specification, and Verification
Year:
2008

Citing 15
Cited 3

Augmented surfaces: a spatially continuous work space for hybrid computing environments

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
The "mighty mouse" multi-screen collaboration tool

Proceedings of the 15th annual ACM symposium on User interface software and technology
PointRight: experience with flexible input redirection in interactive workspaces

Proceedings of the 15th annual ACM symposium on User interface software and technology
A Middleware Infrastructure for Active Spaces

IEEE Pervasive Computing
Virtual Network Computing

IEEE Internet Computing
Halo: a technique for visualizing off-screen objects

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Software Infrastructure for Ubiquitous Computing Environments: Supporting Synchronous Collaboration with Heterogeneous Devices

UbiComp '01 Proceedings of the 3rd international conference on Ubiquitous Computing
EasyLiving: Technologies for Intelligent Environments

HUC '00 Proceedings of the 2nd international symposium on Handheld and Ubiquitous Computing
Mouse ether: accelerating the acquisition of targets across multi-monitor displays

CHI '04 Extended Abstracts on Human Factors in Computing Systems
WinCuts: manipulating arbitrary window regions for more effective use of screen space

CHI '04 Extended Abstracts on Human Factors in Computing Systems
ARIS: an interface for application relocation in an interactive space

GI '04 Proceedings of the 2004 Graphics Interface Conference
Perspective cursor: perspective-based interaction for multi-display environments

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A survey of software infrastructures and frameworks for ubiquitous computing

Mobile Information Systems
Perception of elementary graphical elements in tabletop and multi-surface environments

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
E-conic: a perspective-aware interface for multi-display environments

Proceedings of the 20th annual ACM symposium on User interface software and technology

Multi-modal Interface in Multi-Display Environment for Multi-users

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Cloud displays for mobile users in a display cloud

Proceedings of the 14th Workshop on Mobile Computing Systems and Applications
A context-aware service provision system for smart environments based on the user interaction modalities

Journal of Ambient Intelligence and Smart Environments - Context Awareness

Quantified Score

Hi-index	0.00

Visualization

Abstract

Current multi-display environments (MDEs) can be composed of displays with different characteristics (e.g. resolution, size) located in any position and at different angles. These heterogeneous arrangements present specific interface problems: it is difficult to provide meaningful transitions of cursors between displays; it is difficult for users to visualize information that is presented on oblique surfaces; and it is difficult to spread visual information over multiple displays. In this paper we present a middleware architecture designed to support a new kind of perspective-aware GUI that solves the aforementioned problems. Our interaction architecture combines distributed input and position tracking data to generate perspective-corrected output in each of the displays, allowing groups of users to manipulate existing applications from current operating systems across a large number of displays. To test our design we implemented a complex MDE prototype and measured different aspects of its performance.