The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Learning 3D Face Deformation Model: Methods and Applications
|
Author(s): Zhen Wen (University of Illinois at Urbana Chapmaign, USA), Pengyu Hong (Harvard University, USA), Jilin Tu (University of Illinois at Urbana Champaign, USA)and Thomas S. Huang (University of Illinois at Urbana Champaign, USA)
Copyright: 2004
Pages: 24
Source title:
3D Modeling and Animation: Synthesis and Analysis Techniques for the Human Body
Source Author(s)/Editor(s): Nikos Sarris (Informatics & Telematics Institute, Greece)and Michael G. Strintzis (Informatics & Telematics Institute, Greece)
DOI: 10.4018/978-1-59140-299-2.ch010
Purchase
|
Abstract
This chapter presents a unified framework for machine-learning-based facial deformation modeling, analysis and synthesis. It enables flexible, robust face motion analysis and natural synthesis, based on a compact face motion model learned from motion capture data. This model, called Motion Units (Muss), captures the characteristics of real facial motion. The MU space can be used to constrain noisy low-level motion estimation for robust facial motion analysis. For synthesis, a face model can be deformed by adjusting the weights of Mus. The weights can also be used as visual features to learn audio-to-visual mapping using neural networks for real-time, speech-driven, 3D face animation. Moreover, the framework includes parts-based MUs because of the local facial motion and an interpolation scheme to adapt MUs to arbitrary face geometry and mesh topology. Experiments show we can achieve natural face animation and robust non-rigid face tracking in our framework.
Related Content
Annabel Jane Dover, Alex James Pearl.
© 2023.
21 pages.
|
Gail Flockhart.
© 2023.
37 pages.
|
Sally Waterman.
© 2023.
23 pages.
|
Judith Martinez Estrada.
© 2023.
26 pages.
|
Mireia Ludevid Llop.
© 2023.
25 pages.
|
Richard T. Sawdon Smith.
© 2023.
30 pages.
|
Panayotis Papadimitropoulos.
© 2023.
21 pages.
|
|
|