Total variation minimization and graph cuts for moving objects segmentation

• Authors: Florent Ranchin;Antonin Chambolle;Françoise Dibos
• Venue: SSVM'07 Proceedings of the 1st international conference on Scale space and variational methods in computer vision
• Year: 2007

In this paper, we are interested in the application to video segmentation of the discrete shape optimization problem λJ(θ) + Σi (α - fi)θi incorporating a data f = (fi) and a total variation function J, and where the unknown θ = (θi) with θi ∈ {0, 1} is a binary function representing the region to be segmented and α a parameter. Based on the recent works [1], and Darbon and Sigelle [2,3], we justify the equivalence of the shape optimization problem and a weighted TV regularization in the case where J is a "weighted" total variation. For solving this problem, we adapt the projection algorithm proposed in [4] to this case. Another way of solving (1) investigated here is to use graph cuts. Both methods have the advantage to lead to a global minimum. Since we can distinguish moving objects from static elements of a scene by analyzing norm of the optical flow vectors, we choose f as the optical flow norm. In order to have the contour as close as possible to an edge in the image, we use a classical edge detector function as the weight of the weighted total variation. This model has been used in the former work [5]. We also apply the same methods to a video segmentation model used by Jehan-Besson, Barlaud and Aubert. In this case, it is a direct but interesting application of [1], as only standard perimeter is incorporated in the shape functional.