Abstract
This report contributes a coherent framework for the robust tracking of facial structures. The framework comprises)rises aspects of structure and motion problems. as there are Feature extraction, spatial and temporal matching, recalibration. tracking, and reconstruction. The Scene is acquired through a calibrated stereo sensor. A cue processor extracts invariant features in both views, which are spatially matched by geometric relations. The temporal matching takes place via prediction from the tracking module and :a similarity transformation of the features' 2D locations between both views. The head is reconstructed and tracked in 3D. The re-projection of the predicted structure limits the search space of both the cue processor as well as the re-Construction procedure. Due to the focused application. the instability of calibration of the stereo sensor is limited to the relative extrinsic parameters that are re-calibrated during the re-construction process. The framework is practically applied and proven. First experimental results will be discussed and further steps of development within the project are presented.