Haptic and visual rendering for multi-modal exploration of molecular information

• Authors: Sara Comai;Davide Mazza
• Venue: BCS '10 Proceedings of the 24th BCS Interaction Specialist Group Conference
• Year: 2010

The paper presents a system for the multi-modal rendering of molecules. Chemists typically deal with phenomena that are not directly experienceable and usually described by huge amount of data awkward to understand directly. Software tools have been introduced to support data interpretation, without a high degree of interactivity and explorability of the data. This work goes beyond the classical visual representations of molecules and introduces some new ways of exploration and navigation of information on which inter-molecular interactions are based. Target users are researchers and teachers, as integration to their activities. Two different modalities are used: haptical and visual. The former modality consists in the addition of a haptic interface that enables users to feel the interaction forces exerted by the electric field around a molecule. The latter modality shows the features of the same electric field by allowing the user to navigate the information about the values of the field using a visual color-based rendering and adding other visual cues. Implementation details, case studies, and results on the two modalities are described. Eye-tracking, awareness tools, machine learning, coordination, expertise