Learning Intrinsic Video Content Using Levenshtein Distance in Graph Partitioning

• Authors: Jeffrey Ng;Shaogang Gong
• Venue: ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
• Year: 2002

We present a novel approach for automatically learning models of temporal trajectories extracted from video data. Instead of using a representation of linearly time-normalised vectors of fixed-length, our approach makes use of Dynamic Time Warp distance as a similarity measure to capture the underlying ordered structure of variable-length temporal data while removing the non-linear warping of the time scale. We reformulate the structure learning problem as an optimal graphpartitioning of the dataset to solely exploit Dynamic Time Warp similarity weights without the need for intermediate cluster centroid representations. We extend the graph partitioning method and in particular, the Normalised Cut model originally introduced for static image segmentation to unsupervised clustering of temporal trajectories withfully automated model order selection. By computing hierarchical average Dynamic Time Warp for eachcluster, we learn warp-free trajectory models and recover the time warp profiles and structural variance in the data. We demonstrate the approach on modelling trajectories of continuous hand-gestures and moving objects in an indoor environment.