[go: up one dir, main page]

Thies et al., 2015 - Google Patents

Real-time expression transfer for facial reenactment.

Thies et al., 2015

View PDF
Document ID
391289926406962623
Author
Thies J
Zollhöfer M
Nießner M
Valgaerts L
Stamminger M
Theobalt C
Publication year
Publication venue
ACM Trans. Graph.

External Links

Snippet

We present a method for the real-time transfer of facial expressions from an actor in a source video to an actor in a target video, thus enabling the ad-hoc control of the facial expressions of the target actor. The novelty of our approach lies in the transfer and photorealistic re …
Continue reading at www.niessnerlab.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K9/00268—Feature extraction; Face representation
    • G06K9/00281—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • G06T3/0068—Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image for image registration, e.g. elastic snapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/62—Methods or arrangements for recognition using electronic means
    • G06K9/6201—Matching; Proximity measures
    • G06K9/6202—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image

Similar Documents

Publication Publication Date Title
Thies et al. Real-time expression transfer for facial reenactment.
Zollhöfer et al. State of the art on monocular 3D face reconstruction, tracking, and applications
Thies et al. Headon: Real-time reenactment of human portrait videos
US20180068178A1 (en) Real-time Expression Transfer for Facial Reenactment
Thies et al. Facevr: Real-time facial reenactment and eye gaze control in virtual reality
Ichim et al. Dynamic 3D avatar creation from hand-held video input
Thies et al. Face2face: Real-time face capture and reenactment of rgb videos
Achenbach et al. Fast generation of realistic virtual humans
Bermano et al. Makeup lamps: Live augmentation of human faces via projection
Wu et al. Real-time shading-based refinement for consumer depth cameras
Shi et al. Automatic acquisition of high-fidelity facial performances using monocular videos
Zhi et al. Texmesh: Reconstructing detailed human texture and geometry from rgb-d video
Bickel et al. Multi-scale capture of facial geometry and motion
Pighin et al. Synthesizing realistic facial expressions from photographs
Cao et al. 3D shape regression for real-time facial animation
Valgaerts et al. Lightweight binocular facial performance capture under uncontrolled lighting.
Hauswiesner et al. Virtual try-on through image-based rendering
Bermano et al. Facial performance enhancement using dynamic shape space analysis
Li et al. Capturing relightable human performances under general uncontrolled illumination
Ma et al. Real-time hierarchical facial performance capture
WO2009151755A2 (en) Video processing
Duan et al. Bakedavatar: Baking neural fields for real-time head avatar synthesis
Kabadayi et al. Gan-avatar: Controllable personalized gan-based human head avatar
Eisert et al. Volumetric video–acquisition, interaction, streaming and rendering
Li et al. Spa: Sparse photorealistic animation using a single rgb-d camera