Contact force and finger angles estimation for touch panel by detecting transmitted light on fingernail

Authors:
Yoichi Watanabe;Yasutoshi Makino;Katsunari Sato;Takashi Maeno
Affiliations:
Graduate School of System Design and Management, Keio University, Yokohama, Japan;Center for Education and Research of Symbiotic, Safe and Secure System Design, Keio University, Yokohama, Japan;Graduate School of System Design and Management, Keio University, Yokohama, Japan;Graduate School of System Design and Management, Keio University, Yokohama, Japan
Venue:
EuroHaptics'12 Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part I
Year:
2012

Citing 8
Cited 1

Pressure widgets

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PreSenseII: bi-directional touch and pressure sensing interactions with tactile feedback

CHI '06 Extended Abstracts on Human Factors in Computing Systems
Measuring Fingertip Forces by Imaging the Fingernail

VR '06 Proceedings of the IEEE conference on Virtual Reality
Realization of button click feeling by use of ultrasonic vibration and force feedback

WHC '09 Proceedings of the World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
Detecting and leveraging finger orientation for interaction with direct-touch surfaces

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Getting practical with interactive tabletop displays: designing for dense data, "fat fingers," diverse interactions, and face-to-face collaboration

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Characteristics of pressure-based input for mobile devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Life log system based on tactile sound

EuroHaptics'10 Proceedings of the 2010 international conference on Haptics: generating and perceiving tangible sensations, Part I

Pseudo-pressure detection and its use in predictive text entry on touchscreens

Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a new method that can estimate a normal force and finger posture for touch panel devices by measuring transmitted light on fingernail. When a user touches a light source with their finger, the light (mainly red component) can be seen at a fingernail since the red light can go through the finger tissue. Based on this characteristic, we can estimate the manipulatory force by detecting the light intensity at the fingernail because the intensity of the transmitted light increases according to the applied force. We can also estimate the relative angles of the finger to a touch panel device. Even though the transmission through the finger tissue is diffusive, we can know the movement of the light source under the finger with a camera attached onto the fingernail. Therefore, a transient trajectory pattern of the light source is useful for estimating the relative direction between the finger and the device. When the posture of the finger is estimated, we can use "rotate" motion for manipulation. Our proposed method can be used as a new input device.