Eigenfiltering for Flexible EigenTracking
 (with  J. Vitrià, Petia Radeva and J. Melenchón )
 

 
ABSTRACT: Traditional techniques for tracking non-rigid objects such as optical flow, correlation, active contours or color, can not deal with situations where image changes are not due to motion but appearance (e.g. tracking the lips when the teeth appear). Two main contributions for appearance tracking of flexible objects are proposed. The first one is a flexible generalization of Eigentracking within the same robust continuous optimization framework.  The second one is a generalization of traditional graylevel eigenspaces, constructing a multiple channel "eigenspace" using filter responses to give robustness against variations in the training conditions such as illumination changes. Additionally, 3D geometric transformations are incorporated, a regularization term is added for numerical stability reasons and the optimization  problem is solved in closed form. Experiments on lip tracking are reported.

 
 

   F. De la Torre, J. Vitria, P. Radeva and J. Melenchón. EigenFiltering for Flexible Eigentracking
15th International Conference on Pattern Recognition (ICPR). Barcelona, September 2000.
(postcript, 1.0 MB) (pdf, 0.49 MB)
 
De la Torre, F.,  Gong S. and McKenna S.  View Alignment with Dynamically Updated Affine Tracking
Automatic Face and Gesture Recognition, Nara, Japan, 14-16 April 1998
 

 

         
  Lip Tracking(2 Mb)  
  Lip Tracking with changes in illumination(0.7 Mb)