IEEE Transactions on Pattern Analysis and Machine Intelligence
Separation of Transparent Layers using Focus
International Journal of Computer Vision
Multi-valued Images and Their Separation
Proceedings of the 10th International Workshop on Theoretical Foundations of Computer Vision: Multi-Image Analysis
3D Object Depth Recovery from Highlights Using Active Sensor and Illumination Control
CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation
International Journal of Computer Vision
Shape from Specular Reflection and Optical Flow
International Journal of Computer Vision
General specular surface triangulation
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
| Hi-index | 0.00 |
A theoretical framework is introduced for the perception of specular surface geometry. When an observer moves in three-dimensional space, real scene features, such as surface markings, remain stationary with respect to the surfaces they belong to. In contrast, a virtual feature, which is the specular reflection of a real feature, travels on the surface. Based on the notion of caustics, a novel feature classification algorithm is developed that distinguishes real and virtual features from their image trajectories that result from observer motion. Next, using support functions of curves, a closed-form relation is derived between the image trajectory of a virtual feature and the geometry of the specular surface it travels on. It is shown that in the 2D case where camera motion and the surface profile are coplanar, the profile is uniquely recovered by tracking just two unknown virtual features. Finally, these results are generalized to the case of arbitrary 3D surface profiles that are travelled by virtual features when camera motion is not confined to a plane. An algorithm is developed that uniquely recovers 3D surface profiles using a single virtual feature tracked from the occluding boundary of the object. All theoretical derivations and proposed algorithms are substantiated by experiments.