A multimodal approach to examining 'embodiment' in tangible learning environments

Authors:
Sara Price;Carey Jewitt
Affiliations:
London Knowledge Lab, Institute of Education, London;London Knowledge Lab, Institute of Education, London
Venue:
Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
Year:
2013

Citing 10
Cited 1

Illuminating light: an optical design tool with a luminous-tangible interface

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
How bodies matter: five themes for interaction design

DIS '06 Proceedings of the 6th conference on Designing Interactive systems
Playing with the sound maker: do embodied metaphors help children learn?

IDC '08 Proceedings of the 7th international conference on Interaction design and children
Making New Media: Creative Production and Digital Literacies

Making New Media: Creative Production and Digital Literacies
Children designing together on a multi-touch tabletop: an analysis of spatial orientation and user interactions

Proceedings of the 8th International Conference on Interaction Design and Children
What have you done! the role of 'interference' in tangible environments for supporting collaborative learning

CSCL'09 Proceedings of the 9th international conference on Computer supported collaborative learning - Volume 1
Around the table: are multiple-touch surfaces better than single-touch for children's collaborative interactions?

CSCL'09 Proceedings of the 9th international conference on Computer supported collaborative learning - Volume 1
DIY design process for interactive surfaces

Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Actions speak loudly with words: unpacking collaboration around the table

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Beyond one-size-fits-all: how interactive tabletops support collaborative learning

Proceedings of the 10th International Conference on Interaction Design and Children

Designing a tangible interface for collaborative storytelling to access 'embodiment' and meaning making

Proceedings of the 12th International Conference on Interaction Design and Children

Quantified Score

Hi-index	0.00

Visualization

Abstract

Tangible and multitouch technologies offer new opportunities for physically interacting with objects and digital representations, foregrounding the role of the body in interaction and learning. Developing effective methodologies for examining real time cognition and action, and the relationship between embodiment, interaction and learning is challenging. This paper draws on multimodality, with its emphasis on examining the use of multiple semiotic resources for meaning making, to examine the differential use of semiotic resources by pairs of students interacting with a tangible learning environment. Specifically the analysis details the role of body position, gaze, manipulation and speech in shaping interaction. The analysis illustrates the interaction between these modes and 'multimodal action flow', particularly in terms of pace, rhythm and interaction structure, and the implications of this for interaction and the meaning making process.