IEEE Transactions on Visualization and Computer Graphics
Action recognition for human-marionette interaction
Proceedings of the 20th ACM international conference on Multimedia
| Hi-index | 0.00 |
« Somnambule » is a global instrument which produces sound and picture, generated by a gesture - more precisly the pianistic gesture. The sound has its source in two different worlds : the real world for the sound of piano, and the virtual world for the synthetic sounds. The video derives directly from the dynamic of the pianistic gesture, where a character evolves, visible only by the tracks of his movement into a surface. This surface is a "dynamic pinscreen" which has a physical behavior computed in real time on GPU. This work illustrates the difference between the two worlds : the real and the virtual. The two have not the same constraints. Overall, the gesture dynamic is the origin of the sound dynamic and the picture dynamic.