University of Illinois Urbana-Champaign

3D face processing for animation and biometrics

Le, Vuong

Content Files
Vuong_Le.pdf

Permalink

https://hdl.handle.net/2142/49853

Description

Title
3D face processing for animation and biometrics
Author(s)
Le, Vuong
Issue Date
2014-05-30T17:21:07Z
Director of Research (if dissertation) or Advisor (if thesis)
Huang, Thomas S.
Doctoral Committee Chair(s)
Huang, Thomas S.
Committee Member(s)
  • Do, Minh N.
  • Hart, John C.
  • Levinson, Stephen E.
Department of Study
Electrical & Computer Eng
Discipline
Electrical & Computer Engr
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Date of Ingest
2014-05-30T17:21:07Z
Keyword(s)
  • 3D shape modeling
  • performance driven avatar
  • 3D morphable model
  • face tracking
  • optical flow
  • gaze estimation
  • facial animation
  • facial feature localization
  • expression recognition
  • nonrigid tracking
  • motion model
Abstract
In this dissertation we study core problems in 3D face processing with their important applications in biometrics and graphics. We propose efficient and accurate feature based algorithms for facial feature detection, 3D model fitting and tracking from static and dynamic 2D and 3D visual signal input. We also demonstrate the applications of 3D face modeling in avatar animation, expression recognition and eye gaze estimation. The algorithms contribute to a complete framework for image and video analysis and synthesis based on 3D face models. From the experiments on the self-collected and public database, we argue that feature based 3D face processing is robust to variations of environment, competent for highly accurate reconstruction of 3D facial geometry and motion, and suitable for realtime biometrics and animation applications. The contributions of this dissertation include: (1) A novel interactive robust facial component localization algorithm designed to accommodate partial labels on natural images. (2) A new challenging dataset for facial component localization which contains 2330 high-resolution, accurately labeled face images and has larger degree of out-of-plane orientation and occlusion typical of real-world scenarios. (3) Efficient algorithms for fitting and tracking of 3D model to 2D videos and RGB-D videos based on an iterative linearized optimization procedure. (4) An MPEG-4 compatible performance driven avatar capable of rendering of highly detail shape and texture of the subject in real time. (5) A new method for measuring similarity of 3D facial shapes using facial level curves. The measurement comprises the spatio-temporal features for expression recognition from 3D dynamic faces through a hidden Markov model. (6) An efficient and accurate system for measuring the online student's point of gaze using commodity webcams.
Graduation Semester
2014-05
Permalink
http://hdl.handle.net/2142/49853
Copyright and License Information
Copyright 2014 Vuong Van Le

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Electrical and Computer Engineering
Dissertations and Theses in Electrical and Computer Engineering