Files in this item



application/pdfVuong_Le.pdf (10MB)
(no description provided)PDF


Title:3D face processing for animation and biometrics
Author(s):Le, Vuong
Director of Research:Huang, Thomas S.
Doctoral Committee Chair(s):Huang, Thomas S.
Doctoral Committee Member(s):Do, Minh N.; Hart, John C.; Levinson, Stephen E.
Department / Program:Electrical & Computer Eng
Discipline:Electrical & Computer Engr
Degree Granting Institution:University of Illinois at Urbana-Champaign
Subject(s):3D shape modeling
performance driven avatar
3D morphable model
face tracking
optical flow
gaze estimation
facial animation
facial feature localization
expression recognition
nonrigid tracking
motion model
Abstract:In this dissertation we study core problems in 3D face processing with their important applications in biometrics and graphics. We propose efficient and accurate feature based algorithms for facial feature detection, 3D model fitting and tracking from static and dynamic 2D and 3D visual signal input. We also demonstrate the applications of 3D face modeling in avatar animation, expression recognition and eye gaze estimation. The algorithms contribute to a complete framework for image and video analysis and synthesis based on 3D face models. From the experiments on the self-collected and public database, we argue that feature based 3D face processing is robust to variations of environment, competent for highly accurate reconstruction of 3D facial geometry and motion, and suitable for realtime biometrics and animation applications. The contributions of this dissertation include: (1) A novel interactive robust facial component localization algorithm designed to accommodate partial labels on natural images. (2) A new challenging dataset for facial component localization which contains 2330 high-resolution, accurately labeled face images and has larger degree of out-of-plane orientation and occlusion typical of real-world scenarios. (3) Efficient algorithms for fitting and tracking of 3D model to 2D videos and RGB-D videos based on an iterative linearized optimization procedure. (4) An MPEG-4 compatible performance driven avatar capable of rendering of highly detail shape and texture of the subject in real time. (5) A new method for measuring similarity of 3D facial shapes using facial level curves. The measurement comprises the spatio-temporal features for expression recognition from 3D dynamic faces through a hidden Markov model. (6) An efficient and accurate system for measuring the online student's point of gaze using commodity webcams.
Issue Date:2014-05-30
Rights Information:Copyright 2014 Vuong Van Le
Date Available in IDEALS:2014-05-30
Date Deposited:2014-05

This item appears in the following Collection(s)

Item Statistics